-- Logs begin at Sat 2021-11-06 20:01:16 UTC, end at Sat 2021-11-06 22:31:53 UTC. -- Nov 06 20:37:28.716092 ncdv-master-1 systemd[1]: Started Devstack devstack@c-vol.service. Nov 06 20:37:31.718603 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=127309) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 06 20:37:31.719142 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=127309) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 06 20:37:32.092109 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_db.sqlalchemy.engines [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:37:32.309621 ncdv-master-1 cinder-volume[127309]: INFO cinder.rpc [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 20:37:32.315096 ncdv-master-1 cinder-volume[127309]: INFO cinder.rpc [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 20:37:32.322983 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_db.sqlalchemy.engines [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:37:32.402764 ncdv-master-1 cinder-volume[127309]: INFO cinder.volume.manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Determined volume DB was empty at startup. Nov 06 20:37:32.403439 ncdv-master-1 cinder-volume[127309]: DEBUG cinder.volume.manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=127309) __init__ /opt/stack/cinder/cinder/volume/manager.py:281}} Nov 06 20:37:32.411505 ncdv-master-1 cinder-volume[127309]: INFO cinder.volume.manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 20:37:32.412393 ncdv-master-1 cinder-volume[127309]: WARNING stevedore.named [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:37:32.412889 ncdv-master-1 cinder-volume[127309]: WARNING castellan.key_manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:37:32.414697 ncdv-master-1 cinder-volume[127309]: WARNING cinder.keymgr.conf_key_mgr [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:37:32.429483 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_db.sqlalchemy.engines [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:37:32.433695 ncdv-master-1 cinder-volume[127309]: INFO cinder.rpc [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 20:37:32.437429 ncdv-master-1 cinder-volume[127309]: INFO cinder.rpc [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Automatically selected cinder-volume RPC version 3.16 as minimum service version. Nov 06 20:37:32.438095 ncdv-master-1 cinder-volume[127309]: WARNING stevedore.named [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:37:32.438500 ncdv-master-1 cinder-volume[127309]: WARNING castellan.key_manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:37:32.440640 ncdv-master-1 cinder-volume[127309]: INFO cinder.volume.manager [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Image-volume cache enabled for host ncdv-master-1@ceph. Nov 06 20:37:32.448024 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_db.sqlalchemy.engines [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127309) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:37:32.469223 ncdv-master-1 cinder-volume[127309]: INFO oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Starting 1 workers Nov 06 20:37:32.473904 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Started child 127482 {{(pid=127309) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 06 20:37:32.474936 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Full set of CONF: {{(pid=127309) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 06 20:37:32.475297 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ******************************************************************************** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 06 20:37:32.475615 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] Configuration options gathered from: {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 06 20:37:32.476023 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 06 20:37:32.477181 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 06 20:37:32.477472 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ================================================================================ {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 06 20:37:32.478185 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] allow_availability_zone_fallback = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.478584 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] allow_compression_on_image_upload = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.479280 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] allowed_direct_url_schemes = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.479843 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] api_rate_limit = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.480498 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] auth_strategy = keystone {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.481095 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] az_cache_duration = 3600 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.481710 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_availability_zone = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.482260 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_host = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.482783 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.483287 ncdv-master-1 cinder-volume[127482]: INFO cinder.service [-] Starting cinder-volume node (version 19.1.0) Nov 06 20:37:32.483908 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_stats_polling_interval = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.484483 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backup_api_class = cinder.backup.api.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.485017 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.485597 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backup_name_template = backup-%s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.486148 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backup_use_same_host = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.486678 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backup_use_temp_snapshot = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.487205 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] chap_password = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.487727 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] chap_username = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.488275 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.488867 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_internal_tenant_project_id = c964216bf9bf443e843de227ba6e6894 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.489464 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_internal_tenant_user_id = e1dc7c86c5a748f2b07331e648bbc704 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.490043 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cloned_volume_same_az = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.490573 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cluster = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.491156 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] compression_format = gzip {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.491776 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] compute_api_class = cinder.compute.nova.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.492454 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] config_dir = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.492983 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.493586 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] config_source = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.494176 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.494780 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] control_exchange = openstack {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.495428 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] debug = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.495987 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] default_availability_zone = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.496650 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] default_group_type = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.497583 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.498233 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] default_volume_type = ceph {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.499167 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_client_cert = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.500024 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_client_cert_key = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.500900 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_data_namespace = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.501751 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_ssl_cert_path = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.502624 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_ssl_cert_verify = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.503477 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] driver_use_ssl = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.504284 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] enable_force_upload = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.504856 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] enable_new_services = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.505491 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] enable_unsupported_driver = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.506140 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] enabled_backends = ['ceph'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.506713 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] enforce_multipath_for_image_xfer = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.507342 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] filter_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.507908 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_api_insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.508598 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_api_servers = ['http://10.222.0.13/image'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.511120 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_api_ssl_compression = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.511668 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_ca_certificates_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.512222 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_catalog_info = image:glance:publicURL {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.512744 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.513407 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.513960 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.514500 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_num_retries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.515009 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] glance_request_timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.515538 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] goodness_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.516086 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] graceful_shutdown_timeout = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.516665 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] group_api_class = cinder.group.api.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.517160 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] host = ncdv-master-1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.517703 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iet_conf = /etc/iet/ietd.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.518275 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_compress_on_upload = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.518802 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_conversion_address_space_limit = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.519341 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_conversion_cpu_limit = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.519505 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Starting volume driver RBDDriver (1.2.0) Nov 06 20:37:32.520183 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.520761 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_upload_use_cinder_backend = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.521298 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_upload_use_internal_tenant = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.521520 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:32.522019 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_volume_cache_enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.522583 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_volume_cache_max_count = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.523633 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] image_volume_cache_max_size_gb = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.524192 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] init_host_max_objects_retrieval = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.524817 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] instance_format = [instance: %(uuid)s] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.525408 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.526027 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iscsi_iotype = fileio {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.526609 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iscsi_secondary_ip_addresses = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.527204 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iscsi_target_flags = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.527802 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iscsi_write_cache = on {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.528474 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iser_helper = tgtadm {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.529290 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iser_ip_address = 10.222.0.13 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.529948 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iser_port = 3260 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.530524 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.531102 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_config_append = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.531703 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.532277 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_dir = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.532873 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.533373 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_options = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.533965 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_rotate_interval = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.534560 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_rotate_interval_type = days {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.535175 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] log_rotation_type = none {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.535696 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.536207 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.536811 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.537401 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.537913 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.539072 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] max_age = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.539635 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] max_logfile_count = 30 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.540262 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] max_logfile_size_mb = 200 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.540878 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] max_over_subscription_ratio = 20.0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.541459 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] message_reap_interval = 86400 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.542253 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] message_ttl = 2592000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.542645 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] migration_create_volume_timeout_secs = 300 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.543004 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] monkey_patch = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.543387 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] monkey_patch_modules = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.543693 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] my_ip = 10.222.0.13 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.544051 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] no_snapshot_gb_quota = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.544450 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] num_iser_scan_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.544848 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] num_shell_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.545200 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] num_volume_device_scan_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.545557 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] nvmet_ns_id = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.545914 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] nvmet_port_id = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.546296 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_max_limit = 1000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.546654 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_ext_list = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.547076 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.547599 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_listen = 0.0.0.0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.548133 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_listen_port = 8776 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.548547 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_use_ssl = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.548909 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] osapi_volume_workers = 2 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.549530 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] per_volume_size_limit = -1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.550036 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] periodic_fuzzy_delay = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.550559 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] periodic_interval = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.551275 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] public_endpoint = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.551837 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] publish_errors = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.552483 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_backup_gigabytes = 1000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.553108 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_backups = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.553565 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_consistencygroups = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.554051 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.554474 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_gigabytes = 1000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.554949 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_groups = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.555376 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_snapshots = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.555829 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] quota_volumes = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.556265 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] rate_limit_burst = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.556724 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] rate_limit_except_level = CRITICAL {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.557157 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] rate_limit_interval = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.557588 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] reinit_driver_count = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.558004 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] replication_device = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.558439 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] report_discard_supported = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.558851 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] report_interval = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.559394 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] reservation_clean_interval = 86400 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.559755 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] reservation_expire = 86400 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.560204 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] reserved_percentage = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.560716 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.561147 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.561606 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] rpc_response_timeout = 120 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.562040 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] run_external_periodic_tasks = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.562472 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.562900 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] scst_target_driver = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.563316 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] scst_target_iqn_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.563671 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_down_time = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.564136 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] snapshot_name_template = snapshot-%s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.564615 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] snapshot_same_host = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.565051 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] split_loggers = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.565406 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] state_path = /opt/stack/data/cinder {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.565832 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] storage_availability_zone = nova {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.566266 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] storage_protocol = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.566712 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] syslog_log_facility = LOG_USER {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.567142 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] target_helper = lioadm {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.567676 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] target_ip_address = 10.222.0.13 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.568253 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] target_port = 3260 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.568866 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.569468 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] target_protocol = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.570071 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] trace_flags = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.570511 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] transfer_api_class = cinder.transfer.api.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.570957 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] transport_url = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.571382 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] until_refresh = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.571798 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_chap_auth = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.572206 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_default_quota_class = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.572671 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_eventlog = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.573119 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_journal = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.573526 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_json = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.573939 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_multipath_for_image_xfer = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.574399 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_stderr = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.574808 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] use_syslog = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.575266 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] verify_glance_signatures = enabled {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.575693 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_api_class = cinder.volume.api.API {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.576126 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_backend_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.576600 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_clear = zero {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.577021 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_clear_ionice = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.577586 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_clear_size = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.578190 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.578766 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_copy_bps_limit = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.579336 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_dd_blocksize = 1M {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.579954 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.580551 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_name_template = volume-%s {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.581556 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_service_inithost_offload = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.582182 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volume_usage_audit_period = month {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.582897 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.583508 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] watch_log_file = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.583925 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] zoning_mode = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 06 20:37:32.584491 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.585009 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.enforce_new_defaults = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.586212 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.enforce_scope = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.586769 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.policy_default_rule = default {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.587182 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.587575 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.policy_file = policy.yaml {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.587999 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.588407 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.588540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:32.589023 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.589542 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.590083 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.590668 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_concurrency.disable_process_locking = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.591224 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.591826 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.admin_password = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.592418 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.admin_tenant_name = admin {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.592944 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.admin_token = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.593473 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.admin_user = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.594031 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_admin_prefix = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.594570 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.595141 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_port = 35357 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.595717 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_protocol = https {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.596313 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_section = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.596893 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_type = password {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.597455 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_uri = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.598001 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.auth_version = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.598557 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.cache = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.599124 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.599705 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.600258 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.delay_auth_decision = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.600979 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.601567 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.http_connect_timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.602146 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.602699 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.identity_uri = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.603252 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.include_service_catalog = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.603834 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.604465 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.interface = public {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.605090 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.605533 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.605959 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.606405 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.606825 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.607255 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.607690 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.608162 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.608638 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.609250 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.609850 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.region_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.610447 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.611068 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.service_token_roles_required = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.611609 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.service_type = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.612115 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.token_cache_time = 300 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.612717 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] keystone_authtoken.www_authenticate_uri = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.613341 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.backend = dogpile.cache.null {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.613733 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.backend_argument = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.614261 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.config_prefix = cache.oslo {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.614801 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.debug_cache_backend = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.615172 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.615543 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.expiration_time = 600 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.615903 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_dead_retry = 300 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.616308 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.617226 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.617598 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_pool_maxsize = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.617970 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.618381 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.618801 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.memcache_socket_timeout = 1.0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.619188 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.proxies = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.619476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:32.619594 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.tls_allowed_ciphers = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.619906 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.tls_cafile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.620266 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.tls_certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.620650 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.tls_enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.621018 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cache.tls_keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.621414 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] coordination.backend_url = etcd3+http://10.222.0.13:2379 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.621858 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.backend = sqlalchemy {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.622172 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.connection = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.622549 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.connection_debug = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.622921 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.connection_parameters = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.623270 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.connection_recycle_time = 3600 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.623630 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.connection_trace = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.623978 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.db_inc_retry_interval = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.624445 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.db_max_retries = 20 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.624797 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.db_max_retry_interval = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.625149 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.db_retry_interval = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.625505 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.max_overflow = 50 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.625852 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.max_pool_size = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.626211 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.max_retries = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.626550 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.mysql_enable_ndb = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.627108 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.627644 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.pool_timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.628329 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.retry_interval = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.628887 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.slave_connection = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.629423 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.sqlite_synchronous = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.629956 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] database.use_db_reconnect = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.630525 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.631194 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.631758 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.632394 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.632934 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.633518 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.connection_string = messaging:// {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.634006 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.634636 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.es_doc_type = notification {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.635187 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.es_scroll_size = 10000 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.635727 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.es_scroll_time = 2m {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.636307 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.filter_error_trace = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.638113 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.hmac_keys = SECRET_KEY {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.638733 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.sentinel_service_name = mymaster {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.639296 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.socket_timeout = 0.1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.639842 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] profiler.trace_sqlalchemy = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.640474 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.capabilities = [21] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.641283 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.group = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.641859 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.helper_command = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.642400 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.logger_name = oslo_privsep.daemon {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.642790 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.643152 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] privsep_osbrick.user = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.643743 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.644096 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.group = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.644481 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.helper_command = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.644857 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.645358 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.645918 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] cinder_sys_admin.user = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.648185 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.auth_section = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.649672 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.auth_type = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.649672 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.cafile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.649672 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.650829 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.collect_timing = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.651403 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.651980 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.652921 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.send_service_user_token = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.653612 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.split_loggers = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.654173 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] service_user.timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.654923 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.backend_availability_zone = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.655509 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.657997 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.658674 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.chap_password = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.659293 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.chap_username = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.659938 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.660580 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.deferred_deletion_delay = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.661219 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.deferred_deletion_purge_interval = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.661827 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_client_cert = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.662401 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_client_cert_key = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.662953 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_data_namespace = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.664029 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.664617 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.664966 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.driver_use_ssl = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.665336 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.enable_deferred_deletion = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.665939 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.enable_unsupported_driver = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.667269 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.668427 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.extra_capabilities = {} {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.669289 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.filter_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.672280 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.goodness_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.672974 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iet_conf = /etc/iet/ietd.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.674543 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.675800 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.676872 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.677465 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.677989 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.678520 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iscsi_iotype = fileio {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.679117 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iscsi_secondary_ip_addresses = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.680200 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iscsi_target_flags = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.680441 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.driver [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Driver hasn't implemented _init_vendor_properties() Nov 06 20:37:32.680934 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iscsi_write_cache = on {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.681044 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.driver [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Initialized capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:bb7c4f49-4c43-48e3-a26b-9f8a53cc7fd9:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127482) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:820}} Nov 06 20:37:32.681707 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iser_helper = tgtadm {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.682491 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iser_ip_address = 10.222.0.13 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.683032 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iser_port = 3260 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.683597 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.684159 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.684723 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.685283 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.num_shell_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.685825 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.686361 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.686891 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.nvmet_port_id = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.687427 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rados_connect_timeout = -1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.687977 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rados_connection_interval = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.688546 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rados_connection_retries = 3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.689094 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_ceph_conf = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.689641 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_cluster_name = ceph {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.690782 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_exclusive_cinder_pool = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.691256 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_flatten_volume_from_snapshot = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.691721 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_max_clone_depth = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.692190 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_pool = rbd {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.692680 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_secret_uuid = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.693127 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_store_chunk_size = 4 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.693691 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.rbd_user = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.694273 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.replication_connect_timeout = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.694866 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.replication_device = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.695264 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:37:32.695649 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.report_discard_supported = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.696207 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.report_dynamic_total_capacity = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.696807 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.reserved_percentage = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.697474 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.scst_target_driver = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.698021 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.scst_target_iqn_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.698613 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.storage_protocol = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.699164 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.699749 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.target_helper = tgtadm {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.700503 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.target_ip_address = 10.222.0.13 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.701072 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.target_port = 3260 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.701657 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.702242 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.target_protocol = iscsi {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.702790 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.trace_flags = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.703374 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.unique_fqdn_network = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.703936 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.use_chap_auth = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.704550 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.705099 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_backend_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.705669 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_clear = zero {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.706236 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_clear_ionice = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.706788 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_clear_size = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.707351 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.707915 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.708539 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.709192 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.709846 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.710493 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_reports.file_event_handler = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.711082 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.711654 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_reports.log_dir = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.712245 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.backend_availability_zone = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.712855 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.backend_host = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.713405 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.backend_native_threads_pool_size = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.713962 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.backup_use_temp_snapshot = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.714529 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.chap_password = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.715075 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.chap_username = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.715633 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.chiscsi_conf = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.716177 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.deferred_deletion_delay = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.716760 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.deferred_deletion_purge_interval = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.717304 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_client_cert = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.717854 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_client_cert_key = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.718400 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_data_namespace = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.718931 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_ssl_cert_path = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.719947 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_ssl_cert_verify = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.720437 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.driver_use_ssl = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.721009 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.enable_deferred_deletion = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.721566 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.enable_unsupported_driver = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.722237 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.enforce_multipath_for_image_xfer = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.722824 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.extra_capabilities = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.723247 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.filter_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.723664 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.goodness_function = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.724103 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iet_conf = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.725311 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.image_upload_use_cinder_backend = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.726716 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.image_upload_use_internal_tenant = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.727306 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.image_volume_cache_enabled = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.727871 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.image_volume_cache_max_count = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.728469 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.image_volume_cache_max_size_gb = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.729040 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iscsi_iotype = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.729609 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iscsi_secondary_ip_addresses = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.730166 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iscsi_target_flags = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.730725 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iscsi_write_cache = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.731287 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iser_helper = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.731854 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iser_ip_address = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.732468 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iser_port = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.733041 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.iser_target_prefix = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.733589 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.max_over_subscription_ratio = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.734136 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.num_iser_scan_tries = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.734680 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.num_shell_tries = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.735261 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.num_volume_device_scan_tries = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.735816 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.nvmet_ns_id = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.736408 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.nvmet_port_id = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.736975 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rados_connect_timeout = -1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.737529 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rados_connection_interval = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.738093 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rados_connection_retries = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.738630 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_ceph_conf = /etc/ceph/ceph.conf {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.738985 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_cluster_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.739480 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_exclusive_cinder_pool = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.739853 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_flatten_volume_from_snapshot = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.740219 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_max_clone_depth = 5 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.740621 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_pool = volumes {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.740989 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_secret_uuid = d045347e-7923-456e-9e0d-82bea865ebee {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.741351 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_store_chunk_size = 4 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.742270 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.rbd_user = cinder {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.742652 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.replication_connect_timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.742968 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.replication_device = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.743313 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.report_discard_supported = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.743660 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.report_dynamic_total_capacity = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.744000 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.reserved_percentage = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.744654 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.scst_target_driver = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.744889 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.scst_target_iqn_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.745234 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.storage_protocol = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.745585 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.suppress_requests_ssl_warnings = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.745933 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.target_helper = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.746309 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.target_ip_address = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.746659 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.target_port = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.747005 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.target_prefix = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.747235 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.db.sqlalchemy.api [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Building query based on filter {{(pid=127482) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3141}} Nov 06 20:37:32.747352 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.target_protocol = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.747671 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.trace_flags = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.748011 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.unique_fqdn_network = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.748384 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.use_chap_auth = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.748729 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.use_multipath_for_image_xfer = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.749090 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_backend_name = ceph {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.749430 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_clear = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.749769 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_clear_ionice = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.750108 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_clear_size = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.750449 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_copy_blkio_cgroup_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.750810 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_copy_bps_limit = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.751149 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_dd_blocksize = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.751506 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volume_driver = cinder.volume.drivers.rbd.RBDDriver {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.751849 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ceph.volumes_dir = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.752409 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.752804 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.753175 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.753690 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.754228 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.754733 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.755269 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.755781 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.756282 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.756808 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.757372 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.757889 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.758429 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.759010 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.759540 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.760118 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.760661 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.761031 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.761379 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.761750 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.762133 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.762526 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.ssl = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.762890 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.763366 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.763734 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.764111 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_rabbit.ssl_version = {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.764451 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_notifications.driver = [] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.764817 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_notifications.retry = -1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.765370 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.765878 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] oslo_messaging_notifications.transport_url = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.766362 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.766799 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] key_manager.fixed_key = **** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.767397 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.767906 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.barbican_api_version = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.768101 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=127482) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:955}} Nov 06 20:37:32.768596 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.barbican_endpoint = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.769149 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.barbican_endpoint_type = public {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.769654 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.barbican_region_name = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.770142 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.cafile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.770629 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.771138 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.collect_timing = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.771643 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.772132 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.772680 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.number_of_retries = 60 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.773199 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.retry_delay = 1 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.773746 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.send_service_user_token = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.774237 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.split_loggers = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.774722 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.775233 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.verify_ssl = True {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.775746 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican.verify_ssl_path = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.776266 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.auth_section = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.776802 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.auth_type = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.777290 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.cafile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.777799 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.778293 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.collect_timing = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.778795 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.779290 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.779415 ncdv-master-1 cinder-volume[127482]: INFO cinder.keymgr.migration [None req-c014f0dc-0b83-43d1-a4d9-dc0058abc410 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 20:37:32.779888 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.split_loggers = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.780417 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] barbican_service_user.timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.780936 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.approle_role_id = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.781494 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.approle_secret_id = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.782128 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.cafile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.782735 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.certfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.783301 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.collect_timing = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.783408 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:32.783951 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.insecure = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.784617 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.keyfile = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.785182 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.kv_mountpoint = secret {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.785733 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.kv_version = 2 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.786292 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.namespace = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.786840 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.root_token_id = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.787385 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.split_loggers = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.787937 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.ssl_ca_crt_file = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.789026 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.timeout = None {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.789601 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.use_ssl = False {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.790168 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 06 20:37:32.790663 ncdv-master-1 cinder-volume[127309]: DEBUG oslo_service.service [None req-baf51217-89ea-4fc4-a413-db99a16c665e None None] ******************************************************************************** {{(pid=127309) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 06 20:37:32.815342 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:32.845728 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:37:32.882491 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Driver initialization completed successfully. Nov 06 20:37:32.890627 ncdv-master-1 cinder-volume[127482]: INFO cinder.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Initiating service 3 cleanup Nov 06 20:37:32.896267 ncdv-master-1 cinder-volume[127482]: INFO cinder.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Service 3 cleanup completed. Nov 06 20:37:32.896643 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.service [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Creating RPC server for service cinder-volume {{(pid=127482) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 20:37:32.902665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.service [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=127482) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 20:37:32.974973 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Initializing RPC dependent components of volume driver RBDDriver (1.2.0) Nov 06 20:37:32.976595 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:33.014405 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:37:33.063505 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1bb18650-64da-4776-9fa5-78f17724d7ca None None] Driver post RPC initialization completed successfully. Nov 06 20:39:10.065687 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:39:10.066571 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:39:10.088572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:39:10.112103 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:40:10.068255 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:40:10.068975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:40:10.090648 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:40:10.113975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:41:10.069470 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:41:10.070144 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:41:10.089948 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:41:10.111041 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:42:10.066621 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:42:10.067298 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:42:10.087590 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:42:10.114602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:43:10.070139 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:43:10.070844 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:43:10.092776 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:43:10.113198 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:44:10.067963 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:44:10.068680 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:44:10.092941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:44:10.114024 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:45:10.068903 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:45:10.069633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:45:10.090107 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:45:10.110746 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:46:10.066769 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:46:10.067495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:46:10.098977 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:46:10.122567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:47:10.071420 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:47:10.080937 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:47:10.142090 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:47:10.205724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:48:10.068791 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:48:10.069566 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:48:10.121158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:48:10.183661 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:49:10.070889 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:49:10.073034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:49:10.135159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:49:10.204913 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:49:51.883238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:49:51.916559 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:49:51.922746 ncdv-master-1 cinder-volume[127482]: INFO cinder.rpc [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Automatically selected cinder-backup objects version 1.39 as minimum service version. Nov 06 20:49:51.933014 ncdv-master-1 cinder-volume[127482]: INFO cinder.rpc [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Automatically selected cinder-backup RPC version 2.2 as minimum service version. Nov 06 20:49:51.937580 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:49:51.938288 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:49:52.025868 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (718a9537-aab7-496b-9d64-93f2be76c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:49:52.039777 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b62495d-5960-4ac6-b702-ecb4326a6d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:49:52.051889 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:49:52.162366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b62495d-5960-4ac6-b702-ecb4326a6d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-873193908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f35eb51-5bb5-43ec-a170-cc81ed19014d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f37b0e9c3a4480a04ebeec1085ec97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:49:52Z,use_quota=True,user_id='407605b252be40ad88a3fce348750e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:49:52.168986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1aabcec-21fa-49b4-a521-a8d6ebb6d380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:49:52.173939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1aabcec-21fa-49b4-a521-a8d6ebb6d380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:49:52.178704 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb568d15-7921-42c8-8c53-a7c25fd2092a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:49:52.336378 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb568d15-7921-42c8-8c53-a7c25fd2092a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'volume_name': 'volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:49:52.341376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebad9956-3112-4516-b481-891c5171680e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:49:52.351914 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebad9956-3112-4516-b481-891c5171680e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:49:52.355071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa8f71d-e729-4dcb-88fb-019ef67ebfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:49:52.356076 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume 7f35eb51-5bb5-43ec-a170-cc81ed19014d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 20:49:52.356913 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Cloning 7f35eb51-5bb5-43ec-a170-cc81ed19014d from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 20:49:52.399235 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.036s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:49:52.416406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Preparing cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:875}} Nov 06 20:49:52.417923 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 20:50:09.199961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph, size 616.00 MB, duration 16.78 sec {{(pid=127482) fetch /opt/stack/cinder/cinder/image/image_utils.py:580}} Nov 06 20:50:09.201126 ncdv-master-1 cinder-volume[127482]: INFO cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Image download 616.00 MB at 36.72 MB/s Nov 06 20:50:09.270360 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:09.588424 ncdv-master-1 sudo[139213]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph Nov 06 20:50:09.589925 ncdv-master-1 sudo[139213]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:10.072653 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:50:10.074327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:10.107653 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:10.161368 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:50:10.355592 ncdv-master-1 sudo[139213]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:10.357578 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph" returned: 0 in 1.087s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:10.370598 ncdv-master-1 cinder-volume[127482]: WARNING py.warnings [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 06 20:50:10.370598 ncdv-master-1 cinder-volume[127482]: debtcollector.deprecate( Nov 06 20:50:10.370598 ncdv-master-1 cinder-volume[127482]: Nov 06 20:50:10.370598 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Temporary image 84b8d88b-fc57-44cc-ba26-535c5373e60c is fetched for user 407605b252be40ad88a3fce348750e79. {{(pid=127482) fetch /opt/stack/cinder/cinder/image/image_utils.py:1088}} Nov 06 20:50:10.448126 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:10.585889 ncdv-master-1 sudo[139251]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph Nov 06 20:50:10.586731 ncdv-master-1 sudo[139251]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:11.152145 ncdv-master-1 sudo[139251]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:11.154276 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph" returned: 0 in 0.706s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:11.155683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] creating volume 'volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:50:11.157145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:11.324423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:11.325122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:11.353698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Attempting download of 84b8d88b-fc57-44cc-ba26-535c5373e60c ((None, None)) to volume 7f35eb51-5bb5-43ec-a170-cc81ed19014d. {{(pid=127482) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1228}} Nov 06 20:50:11.422272 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_84b8d88b-fc57-44cc-ba26-535c5373e60c_x8fy9zjs {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:11.548156 ncdv-master-1 sudo[139271]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_84b8d88b-fc57-44cc-ba26-535c5373e60c_x8fy9zjs Nov 06 20:50:11.551027 ncdv-master-1 sudo[139271]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:12.143730 ncdv-master-1 sudo[139271]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:12.146011 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_download_84b8d88b-fc57-44cc-ba26-535c5373e60c_x8fy9zjs" returned: 0 in 0.724s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:12.147325 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:12.245099 ncdv-master-1 sudo[139275]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph Nov 06 20:50:12.245959 ncdv-master-1 sudo[139275]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:12.855231 ncdv-master-1 sudo[139275]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:12.858383 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph" returned: 0 in 0.711s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:12.869747 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] 84b8d88b-fc57-44cc-ba26-535c5373e60c was vhdx, converting to raw {{(pid=127482) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:793}} Nov 06 20:50:12.871214 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp4uoev5jp {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:12.903852 ncdv-master-1 sudo[139280]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp4uoev5jp Nov 06 20:50:12.905400 ncdv-master-1 sudo[139280]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:14.675971 ncdv-master-1 sudo[139280]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:14.678734 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f vhdx /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph /opt/stack/data/cinder/conversion/tmp4uoev5jp" returned: 0 in 1.807s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:14.679772 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): /usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:14.911823 ncdv-master-1 sudo[139306]: ubuntu : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/local/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph Nov 06 20:50:14.915382 ncdv-master-1 sudo[139306]: pam_unix(sudo:session): session opened for user root by (uid=0) Nov 06 20:50:16.080961 ncdv-master-1 sudo[139306]: pam_unix(sudo:session): session closed for user root Nov 06 20:50:16.083252 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "/usr/bin/python3.8 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph" returned: 0 in 1.403s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:16.084567 ncdv-master-1 cinder-volume[127482]: WARNING py.warnings [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] /usr/local/lib/python3.8/dist-packages/oslo_utils/imageutils.py:70: FutureWarning: The human format is deprecated and the format parameter will be removed. Use explicitly json instead in version 'xena' Nov 06 20:50:16.084567 ncdv-master-1 cinder-volume[127482]: debtcollector.deprecate( Nov 06 20:50:16.084567 ncdv-master-1 cinder-volume[127482]: Nov 06 20:50:16.085515 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_84b8d88b-fc57-44cc-ba26-535c5373e60c_idz1brh6ncdv-master-1@ceph, size 700.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/conversion/tmp4uoev5jp {{(pid=127482) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:412}} Nov 06 20:50:16.086095 ncdv-master-1 cinder-volume[127482]: INFO cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Converted 700.00 MB image at 387.06 MB/s Nov 06 20:50:16.088376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:16.212648 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:50:16.224414 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:50:16.245297 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] deleting rbd volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:50:16.280084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:50:16.292241 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:50:16.292876 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:50:16.318602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Flow 'volume_create_manager' (b2e0bb2d-b0a0-4871-8792-ca7eb93f2993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:16.324083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc334062-c963-4eb2-bb36-c0e53656c27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.332285 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:50:16.350567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc334062-c963-4eb2-bb36-c0e53656c27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1464560584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8882978-9643-4508-9f06-f2502787c159,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e36c34c8ba54c99826390aff2abf4d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:50:16Z,use_quota=True,user_id='44347de86f1149a2b9288ca04ec59e13',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.353750 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a6bb18-642a-45ab-b9cb-9fbf6025a9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.356589 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a6bb18-642a-45ab-b9cb-9fbf6025a9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.359739 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537e13f-9d8d-45a7-9bd2-d646049cc660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.362440 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d537e13f-9d8d-45a7-9bd2-d646049cc660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8882978-9643-4508-9f06-f2502787c159', 'volume_name': 'volume-f8882978-9643-4508-9f06-f2502787c159', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.365055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2806f7-6e7e-422f-99cd-0aed272406e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.368248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2806f7-6e7e-422f-99cd-0aed272406e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.371504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0832b8-3d3c-4186-bd19-145509e666fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.372552 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Volume f8882978-9643-4508-9f06-f2502787c159: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8882978-9643-4508-9f06-f2502787c159', 'volume_size': 1} Nov 06 20:50:16.373045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] creating volume 'volume-f8882978-9643-4508-9f06-f2502787c159' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:50:16.374261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:16.471461 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:16.471951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:16.475786 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f0832b8-3d3c-4186-bd19-145509e666fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8882978-9643-4508-9f06-f2502787c159', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.479042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f97d93-a8b9-4acd-8949-d2307c762dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:16.490804 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Volume volume-f8882978-9643-4508-9f06-f2502787c159 (f8882978-9643-4508-9f06-f2502787c159): created successfully Nov 06 20:50:16.493796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f97d93-a8b9-4acd-8949-d2307c762dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:16.498046 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Flow 'volume_create_manager' (b2e0bb2d-b0a0-4871-8792-ca7eb93f2993) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:16.509375 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-01496df5-24ad-4a73-89b3-5af316a95ab2 tempest-DeleteServersTestJSON-254142232 None] Created volume successfully. Nov 06 20:50:16.542627 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp4uoev5jp volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:19.121184 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-cc58a3c0-323c-44d6-a54f-0a222cb335ea req-c4b68c92-470d-4714-9a67-caddc286776b tempest-DeleteServersTestJSON-254142232 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:20.013513 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-cc58a3c0-323c-44d6-a54f-0a222cb335ea req-c4b68c92-470d-4714-9a67-caddc286776b tempest-DeleteServersTestJSON-254142232 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.892s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:20.014392 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-cc58a3c0-323c-44d6-a54f-0a222cb335ea req-c4b68c92-470d-4714-9a67-caddc286776b tempest-DeleteServersTestJSON-254142232 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-f8882978-9643-4508-9f06-f2502787c159', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'f8882978-9643-4508-9f06-f2502787c159', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:50:20.084041 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-cc58a3c0-323c-44d6-a54f-0a222cb335ea req-c4b68c92-470d-4714-9a67-caddc286776b tempest-DeleteServersTestJSON-254142232 None] Connection info returned from driver {'name': 'volumes/volume-f8882978-9643-4508-9f06-f2502787c159', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'f8882978-9643-4508-9f06-f2502787c159', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '049ae322-f0df-49af-b06b-e2e204a03269'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:50:20.211779 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-cc58a3c0-323c-44d6-a54f-0a222cb335ea req-c4b68c92-470d-4714-9a67-caddc286776b tempest-DeleteServersTestJSON-254142232 None] attachment_update completed successfully. Nov 06 20:50:21.483860 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "rbd import --pool volumes --order 22 /opt/stack/data/cinder/conversion/tmp4uoev5jp volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d --new-format --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 4.942s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:21.661429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:21.844999 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:21.845465 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:21.846102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Downloaded image 84b8d88b-fc57-44cc-ba26-535c5373e60c ((None, None)) to volume 7f35eb51-5bb5-43ec-a170-cc81ed19014d successfully. {{(pid=127482) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1268}} Nov 06 20:50:21.915287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Temporary image 84b8d88b-fc57-44cc-ba26-535c5373e60c for user 407605b252be40ad88a3fce348750e79 is deleted. {{(pid=127482) fetch /opt/stack/cinder/cinder/image/image_utils.py:1092}} Nov 06 20:50:21.976519 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecated: Default quota for resource: volumes_ceph is set by the default quota flag: quota_volumes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:50:21.977942 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecated: Default quota for resource: gigabytes_ceph is set by the default quota flag: quota_gigabytes_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:50:22.059674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Created reservations ['7e23e539-6619-4c8f-b2fe-51344665c74a', '5815cbac-b95b-4d9b-b4f0-2d12ae36ab44', '9f45cf14-1dd6-49b3-bdbb-377903abeabc', '35b72b85-7023-4c59-a56d-018ed0c0b834'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:50:22.074944 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Creating image volume entry: {'multiattach': False, 'project_id': 'c964216bf9bf443e843de227ba6e6894', 'provider_location': None, 'bootable': False, 'provider_id': None, 'size': 1, 'replication_extended_status': None, 'display_name': 'image-84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_admin_metadata': [], 'provider_geometry': None, 'replication_status': None, 'metadata': {}, 'shared_targets': True, 'replication_driver_data': None, 'user_id': '407605b252be40ad88a3fce348750e79', 'host': 'ncdv-master-1@ceph#ceph', 'encryption_key_id': None, 'provider_auth': None, 'deleted': False, 'availability_zone': 'nova', 'deleted_at': None, 'volume_type_id': 'af9ed572-999f-44b7-9147-b36cc970d1a9', 'scheduled_at': datetime.datetime(2021, 11, 6, 20, 49, 52, tzinfo=datetime.timezone.utc), 'service_uuid': None, 'terminated_at': None, 'launched_at': None, 'updated_at': datetime.datetime(2021, 11, 6, 20, 49, 52, tzinfo=datetime.timezone.utc), 'display_description': None, 'ec2_id': None, 'volume_glance_metadata': [{'key': 'signature_verified', 'value': 'False'}], 'consistencygroup_id': None, 'created_at': datetime.datetime(2021, 11, 6, 20, 49, 51, tzinfo=datetime.timezone.utc), 'previous_status': None, 'cluster_name': None, 'group_id': None, 'volume_metadata': [], 'attach_status': 'detached', 'status': 'creating', 'source_volid': '7f35eb51-5bb5-43ec-a170-cc81ed19014d'}. {{(pid=127482) _clone_image_volume /opt/stack/cinder/cinder/volume/manager.py:1616}} Nov 06 20:50:22.191419 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume reschedule parameters: False retry: None {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:50:22.197189 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:50:22.197773 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:50:22.214482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (7b2a683b-1886-48aa-9133-dd6d8d9d3678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:22.217738 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294549da-a446-4d88-9cd4-6793fa4f59ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:22.223950 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:50:22.238035 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (294549da-a446-4d88-9cd4-6793fa4f59ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='image-84b8d88b-fc57-44cc-ba26-535c5373e60c',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae8659cd-f08f-4cc7-85c4-f26181745130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c964216bf9bf443e843de227ba6e6894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:49:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=7f35eb51-5bb5-43ec-a170-cc81ed19014d,status='creating',terminated_at=None,updated_at=2021-11-06T20:49:52Z,use_quota=True,user_id='407605b252be40ad88a3fce348750e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:22.241332 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018750f3-0d41-4a71-942c-a4e8363ef51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:22.243452 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (018750f3-0d41-4a71-942c-a4e8363ef51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:22.245778 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e3982-f26d-479f-8b55-ab186b875eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:22.258959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (629e3982-f26d-479f-8b55-ab186b875eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'volume_name': 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130', 'volume_size': 1, 'source_volid': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'source_volstatus': 'downloading'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:22.261252 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1a2bb8-49c0-483c-bbdc-f9e27f38a508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:22.263350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db1a2bb8-49c0-483c-bbdc-f9e27f38a508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:22.265627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491c064-4dc0-42cc-b638-2bd99bbafbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:22.266329 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume ae8659cd-f08f-4cc7-85c4-f26181745130: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130', 'volume_size': 1, 'source_volid': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'source_volstatus': 'downloading'} Nov 06 20:50:22.284217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:22.364905 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] creating snapshot='volume-ae8659cd-f08f-4cc7-85c4-f26181745130.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 20:50:23.389449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] cloning 'volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d@volume-ae8659cd-f08f-4cc7-85c4-f26181745130.clone_snap' to 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 20:50:23.516802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:50:23.525726 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:23.527139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:23.560169 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 20:50:23.562690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f491c064-4dc0-42cc-b638-2bd99bbafbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130', 'volume_size': 1, 'source_volid': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'source_volstatus': 'downloading'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:23.565096 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30504bea-f3b7-4aed-8d72-aa4ce57d86aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:23.576931 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-ae8659cd-f08f-4cc7-85c4-f26181745130 (ae8659cd-f08f-4cc7-85c4-f26181745130): created successfully Nov 06 20:50:23.580326 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30504bea-f3b7-4aed-8d72-aa4ce57d86aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:23.583866 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (7b2a683b-1886-48aa-9133-dd6d8d9d3678) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:23.598878 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Created volume successfully. Nov 06 20:50:23.636784 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Creating new image-volume cache entry for image 84b8d88b-fc57-44cc-ba26-535c5373e60c on ncdv-master-1@ceph#ceph {{(pid=127482) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:104}} Nov 06 20:50:23.645116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] New image-volume cache entry created: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 20, 50, 23, 639720)}. {{(pid=127482) create_cache_entry /opt/stack/cinder/cinder/image/cache.py:129}} Nov 06 20:50:23.651769 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 31.256s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:50:23.652349 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Marking volume 7f35eb51-5bb5-43ec-a170-cc81ed19014d as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 20:50:23.660856 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 7f35eb51-5bb5-43ec-a170-cc81ed19014d. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 20:50:23.661323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Creating volume glance metadata for volume 7f35eb51-5bb5-43ec-a170-cc81ed19014d backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 20:50:23.718314 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa8f71d-e729-4dcb-88fb-019ef67ebfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:23.720791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c556d71-7973-4382-b5d9-152893a04c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:23.729392 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d (7f35eb51-5bb5-43ec-a170-cc81ed19014d): created successfully Nov 06 20:50:23.731678 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c556d71-7973-4382-b5d9-152893a04c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:23.735079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (718a9537-aab7-496b-9d64-93f2be76c628) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:23.743437 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-31a8d59c-cd63-4af8-8d22-797eef069e02 tempest-TaggedBootDevicesTest_v242-541674125 None] Created volume successfully. Nov 06 20:50:25.111735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:50:25.116068 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:50:25.116569 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:50:25.140202 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (28b206b0-e39d-4922-8c3d-dcf555778196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:25.144068 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f670905-ffbd-4f75-9d3b-10197fb4936f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.151521 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:50:25.179110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f670905-ffbd-4f75-9d3b-10197fb4936f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-170777838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c0d911bb-c272-4d66-8272-d951168b4a48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f37b0e9c3a4480a04ebeec1085ec97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:50:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:50:25Z,use_quota=True,user_id='407605b252be40ad88a3fce348750e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.182210 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b84a7-209f-435b-bafe-29ea8b505652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.184284 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a59b84a7-209f-435b-bafe-29ea8b505652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.186601 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dde07b0-40bb-48d0-808e-e1c73ea2b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.188805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2dde07b0-40bb-48d0-808e-e1c73ea2b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d911bb-c272-4d66-8272-d951168b4a48', 'volume_name': 'volume-c0d911bb-c272-4d66-8272-d951168b4a48', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.191005 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cbf99e-9a85-4f6b-84a4-94dd192d302f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.193085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cbf99e-9a85-4f6b-84a4-94dd192d302f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.195217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9f0204-0d9c-4a53-b5fe-7bdc15c1d7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.195972 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume c0d911bb-c272-4d66-8272-d951168b4a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d911bb-c272-4d66-8272-d951168b4a48', 'volume_size': 1} Nov 06 20:50:25.196401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] creating volume 'volume-c0d911bb-c272-4d66-8272-d951168b4a48' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:50:25.197388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:25.327692 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:25.328072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:25.331477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9f0204-0d9c-4a53-b5fe-7bdc15c1d7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d911bb-c272-4d66-8272-d951168b4a48', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.334897 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e59a8-8c82-4076-b462-0492f09e79a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:25.363868 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-c0d911bb-c272-4d66-8272-d951168b4a48 (c0d911bb-c272-4d66-8272-d951168b4a48): created successfully Nov 06 20:50:25.372084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (813e59a8-8c82-4076-b462-0492f09e79a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:25.380445 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (28b206b0-e39d-4922-8c3d-dcf555778196) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:25.399007 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a9559bce-8714-4284-aaca-05f6d5b4ed52 tempest-TaggedBootDevicesTest_v242-541674125 None] Created volume successfully. Nov 06 20:50:26.587351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:50:26.590804 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:50:26.591244 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:50:26.605966 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (6c962179-4436-4127-a831-74170168c85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:26.609350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a8af13-4c6f-42c7-9bed-c6fe7a0a4962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.619546 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:50:26.656359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a8af13-4c6f-42c7-9bed-c6fe7a0a4962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest_v242-volume-404002109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='21f37b0e9c3a4480a04ebeec1085ec97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:50:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:50:27Z,use_quota=True,user_id='407605b252be40ad88a3fce348750e79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.666407 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e48d6-5410-4baf-8865-472eaf1e3b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.669447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (572e48d6-5410-4baf-8865-472eaf1e3b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.671902 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1c2c21-43ac-4654-8b8d-5af9e6ebba46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.677874 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e1c2c21-43ac-4654-8b8d-5af9e6ebba46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'volume_name': 'volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.680668 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a576224-9893-4a7f-947c-35f110a10027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.689640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a576224-9893-4a7f-947c-35f110a10027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.691772 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e201164b-5820-421d-a635-f0fcf9d385ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.692560 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Volume 9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'volume_size': 1} Nov 06 20:50:26.692953 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] creating volume 'volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:50:26.693943 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:50:26.810347 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:50:26.810954 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:50:26.813735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e201164b-5820-421d-a635-f0fcf9d385ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.816727 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074424fb-90ba-4e1c-b511-c9f2c0ce5bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:50:26.829029 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b (9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b): created successfully Nov 06 20:50:26.831002 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (074424fb-90ba-4e1c-b511-c9f2c0ce5bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:50:26.834391 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Flow 'volume_create_manager' (6c962179-4436-4127-a831-74170168c85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:50:26.845126 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-f5964683-e745-4ec2-94fe-bdf1223b148f tempest-TaggedBootDevicesTest_v242-541674125 None] Created volume successfully. Nov 06 20:50:29.313376 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-5d953aca-3707-4a29-b24d-3df248506ff7 req-b836a4c5-b1ec-4cd9-ab65-9a395debbfd1 tempest-DeleteServersTestJSON-254142232 None] Terminate volume connection completed successfully. Nov 06 20:50:29.313969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-5d953aca-3707-4a29-b24d-3df248506ff7 req-b836a4c5-b1ec-4cd9-ab65-9a395debbfd1 tempest-DeleteServersTestJSON-254142232 None] Deleting attachment 049ae322-f0df-49af-b06b-e2e204a03269. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:50:43.126520 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-7760f8e0-1295-41a3-8b50-373c9c14c545 tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:44.157650 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-7760f8e0-1295-41a3-8b50-373c9c14c545 tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.032s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:44.158555 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-7760f8e0-1295-41a3-8b50-373c9c14c545 tempest-TaggedBootDevicesTest_v242-541674125 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:50:44.206943 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-7760f8e0-1295-41a3-8b50-373c9c14c545 tempest-TaggedBootDevicesTest_v242-541674125 None] Connection info returned from driver {'name': 'volumes/volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '7f35eb51-5bb5-43ec-a170-cc81ed19014d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'beb1fd4e-0454-41ba-b84c-996bd092553a'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:50:44.260964 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-7760f8e0-1295-41a3-8b50-373c9c14c545 tempest-TaggedBootDevicesTest_v242-541674125 None] attachment_update completed successfully. Nov 06 20:50:44.655810 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-6408ce47-8750-4962-8d2c-7dad4abfc88f tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:45.474603 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-6408ce47-8750-4962-8d2c-7dad4abfc88f tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.819s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:45.476619 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-6408ce47-8750-4962-8d2c-7dad4abfc88f tempest-TaggedBootDevicesTest_v242-541674125 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-c0d911bb-c272-4d66-8272-d951168b4a48', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'c0d911bb-c272-4d66-8272-d951168b4a48', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:50:45.501719 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-6408ce47-8750-4962-8d2c-7dad4abfc88f tempest-TaggedBootDevicesTest_v242-541674125 None] Connection info returned from driver {'name': 'volumes/volume-c0d911bb-c272-4d66-8272-d951168b4a48', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'c0d911bb-c272-4d66-8272-d951168b4a48', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '42cab9f1-ec03-47b5-8166-c0b38fb90036'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:50:45.558033 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-6408ce47-8750-4962-8d2c-7dad4abfc88f tempest-TaggedBootDevicesTest_v242-541674125 None] attachment_update completed successfully. Nov 06 20:50:45.891826 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-eb858013-d9f7-4479-96c2-5cbf302cfc9e tempest-TaggedBootDevicesTest_v242-541674125 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:50:46.709673 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-eb858013-d9f7-4479-96c2-5cbf302cfc9e tempest-TaggedBootDevicesTest_v242-541674125 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.817s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:50:46.712058 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-eb858013-d9f7-4479-96c2-5cbf302cfc9e tempest-TaggedBootDevicesTest_v242-541674125 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:50:46.741541 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-eb858013-d9f7-4479-96c2-5cbf302cfc9e tempest-TaggedBootDevicesTest_v242-541674125 None] Connection info returned from driver {'name': 'volumes/volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '68b6b3cc-dc4f-4a02-b58b-6e64ee1d7d33'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:50:46.853022 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e03043f2-f494-4fd6-bbac-03a0ff390b4e req-eb858013-d9f7-4479-96c2-5cbf302cfc9e tempest-TaggedBootDevicesTest_v242-541674125 None] attachment_update completed successfully. Nov 06 20:51:10.069591 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:51:10.071583 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:51:10.143378 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:51:10.211158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:52:10.066590 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:52:10.067825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:10.147061 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:10.207289 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:52:19.841744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:52:19.851109 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:52:19.853598 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:52:19.883473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Flow 'volume_create_manager' (f52c3726-4304-4b82-a2ba-63ae15cb77ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:52:19.887690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba98cbb-e391-411a-afcf-5155c60ccbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:19.896623 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:52:19.916435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba98cbb-e391-411a-afcf-5155c60ccbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1419367213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ce9792b5-5699-4e73-8f1a-4e82d8c983fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='669205b495ef4088b1d5dae005f87509',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:52:20Z,use_quota=True,user_id='09ba9c491fa948f3b57c84b232fb54e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:19.919513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641aec91-0b2a-441a-9950-bf38cf1e1574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:19.922283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641aec91-0b2a-441a-9950-bf38cf1e1574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:19.924588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518050c2-098d-4713-8f63-359a5ad0e643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:19.927046 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (518050c2-098d-4713-8f63-359a5ad0e643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'volume_name': 'volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:19.929481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2b418a-e995-409a-a437-a90b83995f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:19.931771 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f2b418a-e995-409a-a437-a90b83995f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:19.934167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4768a8-4563-46d1-9817-42d16d302e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:19.935081 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Volume ce9792b5-5699-4e73-8f1a-4e82d8c983fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'volume_size': 1} Nov 06 20:52:19.935501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] creating volume 'volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:52:19.936895 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:20.027958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:52:20.028259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:52:20.031475 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f4768a8-4563-46d1-9817-42d16d302e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:20.034218 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2069da59-ee47-46c2-b14e-305bcdbd384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:52:20.048429 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Volume volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa (ce9792b5-5699-4e73-8f1a-4e82d8c983fa): created successfully Nov 06 20:52:20.052464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2069da59-ee47-46c2-b14e-305bcdbd384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:52:20.059071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Flow 'volume_create_manager' (f52c3726-4304-4b82-a2ba-63ae15cb77ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:52:20.076254 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8f57b058-2332-4a06-bb74-058808efebfd tempest-AttachSCSIVolumeTestJSON-294316676 None] Created volume successfully. Nov 06 20:52:21.355525 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 req-9e0ead6d-d4c5-4aa0-8d85-0f6512cabfdc tempest-AttachSCSIVolumeTestJSON-294316676 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:52:22.009654 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 req-9e0ead6d-d4c5-4aa0-8d85-0f6512cabfdc tempest-AttachSCSIVolumeTestJSON-294316676 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.654s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:52:22.010761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 req-9e0ead6d-d4c5-4aa0-8d85-0f6512cabfdc tempest-AttachSCSIVolumeTestJSON-294316676 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:52:22.035504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 req-9e0ead6d-d4c5-4aa0-8d85-0f6512cabfdc tempest-AttachSCSIVolumeTestJSON-294316676 None] Connection info returned from driver {'name': 'volumes/volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ce9792b5-5699-4e73-8f1a-4e82d8c983fa', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '03a43562-f0e2-4d53-a49d-ea9f8e9193f1'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:52:22.083831 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-3984aaa2-4230-4b35-ad87-cc55b7ee57a1 req-9e0ead6d-d4c5-4aa0-8d85-0f6512cabfdc tempest-AttachSCSIVolumeTestJSON-294316676 None] attachment_update completed successfully. Nov 06 20:52:25.764560 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-8c88ea8c-fdaa-46a0-8ece-3613a556701c req-9464e477-7f25-4644-bf43-8a094fda4170 tempest-AttachSCSIVolumeTestJSON-294316676 None] Terminate volume connection completed successfully. Nov 06 20:52:25.765700 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c88ea8c-fdaa-46a0-8ece-3613a556701c req-9464e477-7f25-4644-bf43-8a094fda4170 tempest-AttachSCSIVolumeTestJSON-294316676 None] Deleting attachment 03a43562-f0e2-4d53-a49d-ea9f8e9193f1. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:52:31.486906 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Lock "b'cinder-ce9792b5-5699-4e73-8f1a-4e82d8c983fa-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:52:31.524441 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:31.578110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:52:31.579370 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Volume volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:52:31.589114 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] deleting rbd volume volume-ce9792b5-5699-4e73-8f1a-4e82d8c983fa {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:52:32.001886 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Created reservations ['c9778d5c-e1f4-4ee4-90b4-3eae1b94cbc8', 'a81361b1-224b-467c-8d5f-58aaaa59ef41', '3cdd9c83-bf63-4355-83b6-204d147ed2e8', 'cfcd2ecd-0dc2-4b57-a7f2-23fd8650ce74'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:52:32.076960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:32.156467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:52:32.201138 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:52:32.208208 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Deleted volume successfully. Nov 06 20:52:32.228955 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-861c294f-8042-4e44-b005-5bf88385368b tempest-AttachSCSIVolumeTestJSON-294316676 None] Lock "b'cinder-ce9792b5-5699-4e73-8f1a-4e82d8c983fa-delete_volume'" released by "delete_volume" :: held 0.743s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:10.072054 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:53:10.073095 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:10.121752 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:10.196046 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:10.635382 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:53:10.639847 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:53:10.640431 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:53:10.656818 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Flow 'volume_create_manager' (3bbce8e2-37af-4e52-b56c-9b0782a1bf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:10.675618 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128109e-cc84-48e2-bb51-0becb56d5672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.682210 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:53:10.697345 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3128109e-cc84-48e2-bb51-0becb56d5672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1480810017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d738ae4b-8b54-4896-8a4b-f641b20bff4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eab3920bab041b48b11dba429084062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:53:11Z,use_quota=True,user_id='8d6f973f94504ba180b2d4048045dc2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.699893 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aab5a06-292f-456e-8827-3853e19064d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.702007 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aab5a06-292f-456e-8827-3853e19064d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.704638 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15dc96a-0e94-48ef-8ae4-7fc7d9a8b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.707398 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a15dc96a-0e94-48ef-8ae4-7fc7d9a8b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd738ae4b-8b54-4896-8a4b-f641b20bff4f', 'volume_name': 'volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.709653 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8887ac3-20af-4033-bacc-07f3acd91244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.711687 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8887ac3-20af-4033-bacc-07f3acd91244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.714930 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181e4c35-445f-4484-92fa-a7a6c7b44282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.715887 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Volume d738ae4b-8b54-4896-8a4b-f641b20bff4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f', 'volume_size': 1} Nov 06 20:53:10.716492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] creating volume 'volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:53:10.717663 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:10.825373 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:53:10.825628 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:53:10.827766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (181e4c35-445f-4484-92fa-a7a6c7b44282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.831335 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6854c22f-416c-4110-9292-00b8dd5877f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:10.841522 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Volume volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f (d738ae4b-8b54-4896-8a4b-f641b20bff4f): created successfully Nov 06 20:53:10.844724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6854c22f-416c-4110-9292-00b8dd5877f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:10.848073 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Flow 'volume_create_manager' (3bbce8e2-37af-4e52-b56c-9b0782a1bf4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:10.858783 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-8c22223a-9d56-4ad8-9f21-f3ee759fe3d0 req-5656f65c-2a79-485e-8124-ff0851e9b989 tempest-VolumesSnapshotsTestJSON-1484662108 None] Created volume successfully. Nov 06 20:53:12.170506 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-40b5fb2d-18b5-4557-9e94-c3325cb693ac req-588e217b-e13e-46ef-938e-fe4040271015 tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:12.434017 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-40b5fb2d-18b5-4557-9e94-c3325cb693ac req-588e217b-e13e-46ef-938e-fe4040271015 tempest-VolumesSnapshotsTestJSON-1484662108 None] Create snapshot completed successfully Nov 06 20:53:13.575961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] Lock "b'cinder-2ed49e19-a456-498f-968c-d9af37e6e98c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:13.577411 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:14.454429 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] Deprecated: Default quota for resource: snapshots_ceph is set by the default quota flag: quota_snapshots_ceph, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:53:14.496067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] Created reservations ['9add146a-b0ef-47cc-be6b-887294512362', '9a8361ad-4455-4690-9e33-3286e3b435c1', '240c0900-7e67-45bb-b75c-7284352fe642', '2a1d377f-134e-4604-9ecf-d55f54fb8cfe'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:14.545313 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] Delete snapshot completed successfully. Nov 06 20:53:14.551386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-510ca294-faaf-48ef-95b6-0c762b2dbd2a req-04cecb21-b3aa-492b-962e-b44b1e26faec tempest-VolumesSnapshotsTestJSON-1484662108 None] Lock "b'cinder-2ed49e19-a456-498f-968c-d9af37e6e98c-delete_snapshot'" released by "delete_snapshot" :: held 0.975s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:14.910521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Lock "b'cinder-d738ae4b-8b54-4896-8a4b-f641b20bff4f-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:14.989309 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:15.071266 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:53:15.071691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Volume volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:53:15.081702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] deleting rbd volume volume-d738ae4b-8b54-4896-8a4b-f641b20bff4f {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:53:15.480928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Created reservations ['09ed9f54-5ddd-4cfd-a129-e64acd4bf215', '56ccbb14-2d04-4b9d-84e3-3ae8d9861a89', '2bcd5d30-0c44-4421-8b14-47f085cf8e83', 'e1a09101-147b-436f-bec9-de2e561eef1d'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:15.544247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:15.616154 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:15.704635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:15.717548 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Deleted volume successfully. Nov 06 20:53:15.741385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-d14cd778-e5c9-42e7-a34e-beb8b72ba549 req-23bf6c68-e32c-4855-86cb-a68fed5015aa tempest-VolumesSnapshotsTestJSON-1484662108 None] Lock "b'cinder-d738ae4b-8b54-4896-8a4b-f641b20bff4f-delete_volume'" released by "delete_volume" :: held 0.831s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:19.526385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:53:19.555283 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:53:19.555766 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:53:19.571233 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (02ccf118-1d21-43c9-8131-c71a01af28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:19.575468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e393be-df94-4555-abad-b6734db5135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.583786 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:53:19.602352 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17e393be-df94-4555-abad-b6734db5135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-545991517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1b1324d3-1a5f-40dd-b5f5-3802531dd4f5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43a75abd686a48dca918d5c2c2640a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:53:19Z,use_quota=True,user_id='150ba785e98c46bfbd2981c840099c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.605485 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5a4cf-be9e-409f-ab10-2d608512a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.607951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3e5a4cf-be9e-409f-ab10-2d608512a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.610908 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99266b9d-3a15-4017-9c9f-954182062aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.614480 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99266b9d-3a15-4017-9c9f-954182062aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b1324d3-1a5f-40dd-b5f5-3802531dd4f5', 'volume_name': 'volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.617746 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47131375-4463-424c-aee0-6cb4b733a77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.621075 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47131375-4463-424c-aee0-6cb4b733a77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.624023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ef8ca9-377c-4bd9-893f-b3078f90e4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.625380 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Volume 1b1324d3-1a5f-40dd-b5f5-3802531dd4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5', 'volume_size': 1} Nov 06 20:53:19.625991 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] creating volume 'volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:53:19.628647 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:19.730868 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:53:19.731663 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:53:19.734089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ef8ca9-377c-4bd9-893f-b3078f90e4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.737025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59691d76-48c2-4b2e-a156-42d95ff2661c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:19.756242 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Volume volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5 (1b1324d3-1a5f-40dd-b5f5-3802531dd4f5): created successfully Nov 06 20:53:19.758559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59691d76-48c2-4b2e-a156-42d95ff2661c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:19.765549 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (02ccf118-1d21-43c9-8131-c71a01af28d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:19.791802 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a4bbd464-4e7e-4bd1-b22e-3d959e890a79 tempest-VolumesTestJSON-1109118639 None] Created volume successfully. Nov 06 20:53:22.393894 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:53:22.407310 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:53:22.408714 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:53:22.442691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (be50fac8-5f28-4da4-951e-1f19cbe8ad5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:22.446473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6cf3f3-16ff-4c66-8b2d-d02a07cec0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.454684 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:53:22.470724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba6cf3f3-16ff-4c66-8b2d-d02a07cec0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:53:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-167430957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=24ef2805-6baf-498e-8cca-3f821c259823,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43a75abd686a48dca918d5c2c2640a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:53:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:53:22Z,use_quota=True,user_id='150ba785e98c46bfbd2981c840099c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.473780 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ad7d44-9106-4a92-a89d-244d313d32c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.476128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ad7d44-9106-4a92-a89d-244d313d32c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.480363 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd51427-8efa-4b0b-9f3f-aedff54164b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.488147 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd51427-8efa-4b0b-9f3f-aedff54164b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24ef2805-6baf-498e-8cca-3f821c259823', 'volume_name': 'volume-24ef2805-6baf-498e-8cca-3f821c259823', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.491320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0415d09c-568d-4f0b-914d-729dc79ab493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.495991 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0415d09c-568d-4f0b-914d-729dc79ab493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.501280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b784710a-973b-4c56-95b8-51b12f3d3b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.503066 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Volume 24ef2805-6baf-498e-8cca-3f821c259823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24ef2805-6baf-498e-8cca-3f821c259823', 'volume_size': 1} Nov 06 20:53:22.504317 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] creating volume 'volume-24ef2805-6baf-498e-8cca-3f821c259823' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:53:22.506033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:22.652709 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:53:22.653401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:53:22.657083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b784710a-973b-4c56-95b8-51b12f3d3b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24ef2805-6baf-498e-8cca-3f821c259823', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.658605 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390de586-ecc9-4a11-af25-f62351522c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:22.682568 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Volume volume-24ef2805-6baf-498e-8cca-3f821c259823 (24ef2805-6baf-498e-8cca-3f821c259823): created successfully Nov 06 20:53:22.687221 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390de586-ecc9-4a11-af25-f62351522c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:22.694890 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (be50fac8-5f28-4da4-951e-1f19cbe8ad5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:22.717980 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c982d13c-410b-4bcf-89af-d0802acbcb68 tempest-VolumesTestJSON-1109118639 None] Created volume successfully. Nov 06 20:53:24.217207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:53:24.230909 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:53:24.233199 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:53:24.286697 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (4054de9f-7dc0-4548-989a-e4fcbf757d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:24.298192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf778c29-4e8d-457c-a8ac-9e7508d00c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.313116 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:53:24.343755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf778c29-4e8d-457c-a8ac-9e7508d00c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-748699211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cd43b0f1-d573-4b4e-809b-ce84a89e8c32,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='43a75abd686a48dca918d5c2c2640a3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:53:24Z,use_quota=True,user_id='150ba785e98c46bfbd2981c840099c9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.347215 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e87accf-a1a5-4ada-b2f6-c160ea21861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.351004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e87accf-a1a5-4ada-b2f6-c160ea21861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.354626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4faea0a-eaf7-4d68-ae39-da50ff476072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.358280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4faea0a-eaf7-4d68-ae39-da50ff476072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd43b0f1-d573-4b4e-809b-ce84a89e8c32', 'volume_name': 'volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.380784 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a66f03a-faa1-4a1a-ba0d-dd61355a642c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.388448 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a66f03a-faa1-4a1a-ba0d-dd61355a642c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.391362 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eb500a-fc09-419a-9b0e-a72a21a0cdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.392367 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Volume cd43b0f1-d573-4b4e-809b-ce84a89e8c32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32', 'volume_size': 1} Nov 06 20:53:24.392940 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] creating volume 'volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:53:24.394125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:24.520234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:53:24.521360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:53:24.523502 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1eb500a-fc09-419a-9b0e-a72a21a0cdb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.526334 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccc120f-522f-49c8-9c3b-3a35ae1064cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:53:24.551044 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Volume volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32 (cd43b0f1-d573-4b4e-809b-ce84a89e8c32): created successfully Nov 06 20:53:24.555167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ccc120f-522f-49c8-9c3b-3a35ae1064cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:53:24.558525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Flow 'volume_create_manager' (4054de9f-7dc0-4548-989a-e4fcbf757d49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:53:24.575622 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-f744628b-70e3-4291-b5c9-9bd080af33f2 tempest-VolumesTestJSON-1109118639 None] Created volume successfully. Nov 06 20:53:28.503814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-cd43b0f1-d573-4b4e-809b-ce84a89e8c32-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:28.596184 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:28.680283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:53:28.681066 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Volume volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:53:28.697156 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] deleting rbd volume volume-cd43b0f1-d573-4b4e-809b-ce84a89e8c32 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:53:29.142369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Created reservations ['32916cc5-b20e-4dd3-82f7-30a555e93479', '7251eba4-a10a-4305-813e-327ffe135fb6', '4999131f-6ef3-4a12-9a05-4500407c9f70', '1aa776d8-599d-4469-b602-5876d057e30f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:29.228620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:29.297005 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:29.363406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:29.367377 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Deleted volume successfully. Nov 06 20:53:29.392658 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-facc372d-5f7a-4297-9195-a2fbe15a097f tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-cd43b0f1-d573-4b4e-809b-ce84a89e8c32-delete_volume'" released by "delete_volume" :: held 0.891s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:29.779130 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-24ef2805-6baf-498e-8cca-3f821c259823-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:29.858520 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:29.945010 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:53:29.945969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Volume volume-24ef2805-6baf-498e-8cca-3f821c259823 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:53:29.964241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] deleting rbd volume volume-24ef2805-6baf-498e-8cca-3f821c259823 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:53:30.421501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Created reservations ['a6cd6716-d732-4041-a196-e797abf2f317', '9fe966cd-5c5a-4dbb-be5d-a6dc9bb86880', '4886e7d2-48e9-44b7-a15c-b78cbd4fc4e7', '4cdecc1c-f039-4b9f-9017-cc2268184673'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:30.561717 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:30.634670 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:30.688528 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:30.694271 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Deleted volume successfully. Nov 06 20:53:30.716132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-502dfeed-fb1f-4c0e-bc54-8c3efa628799 tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-24ef2805-6baf-498e-8cca-3f821c259823-delete_volume'" released by "delete_volume" :: held 0.937s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:31.028127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5-delete_volume'" acquired by "delete_volume" :: waited 0.036s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:31.091482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:31.167050 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:53:31.167456 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Volume volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:53:31.177100 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] deleting rbd volume volume-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:53:31.567179 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Created reservations ['823d1a9b-fa86-4cac-87b2-0a13aea86a6a', 'c6b32fc7-55ba-42e7-be39-5a53ad0c6f9b', '679ba793-4a87-453e-a204-14d79cf0be0e', '18d375c1-95f8-4dbd-839f-9fd47fa00438'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:31.648014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:31.759889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:31.829491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:31.846962 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Deleted volume successfully. Nov 06 20:53:31.874416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-19ba2b71-be43-4833-aa23-f294c75547d2 tempest-VolumesTestJSON-1109118639 None] Lock "b'cinder-1b1324d3-1a5f-40dd-b5f5-3802531dd4f5-delete_volume'" released by "delete_volume" :: held 0.847s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:53:52.470220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Lock "b'cinder-f8882978-9643-4508-9f06-f2502787c159-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:53:52.552023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:52.627337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:53:52.627620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Volume volume-f8882978-9643-4508-9f06-f2502787c159 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:53:52.635761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] deleting rbd volume volume-f8882978-9643-4508-9f06-f2502787c159 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:53:52.900701 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Created reservations ['2466c448-846f-4341-ab79-a27c44c73bc5', '9e24ca02-0f53-4e42-9b26-0b779be2c158', 'adeb6dc6-451a-4232-b8fe-64c867aa73cc', '8a711ed4-a1b7-42c0-902f-d47371e8af3a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:53:52.950660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:52.985151 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:53:53.031342 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:53:53.036863 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Deleted volume successfully. Nov 06 20:53:53.054310 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6f43f98f-2081-4822-aa11-d8d3bdd89869 tempest-DeleteServersTestJSON-254142232 None] Lock "b'cinder-f8882978-9643-4508-9f06-f2502787c159-delete_volume'" released by "delete_volume" :: held 0.584s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:54:10.072538 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:54:10.074128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:54:10.155608 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:54:10.260712 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:54:27.244031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:54:27.255133 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:54:27.255920 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:54:27.289352 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Flow 'volume_create_manager' (cf6b7009-d9f8-4e0f-b36c-620248a62e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:54:27.293638 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4619c5-f8d2-442a-a03f-dcaab0788a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.302169 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:54:27.319653 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b4619c5-f8d2-442a-a03f-dcaab0788a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-406050080',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e85e14ab-0ae2-4153-91b2-021a2ea6c996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='046b2d11820348118cbe7a156018a1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:54:27Z,use_quota=True,user_id='2db226fb557e4c0aa2e15fcc8d7a488d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.322919 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb6dd1-31e3-43ca-8919-3b7891278221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.325387 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21cb6dd1-31e3-43ca-8919-3b7891278221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.328600 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048f2c7-c392-4530-8165-6b42f75db8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.332340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4048f2c7-c392-4530-8165-6b42f75db8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e85e14ab-0ae2-4153-91b2-021a2ea6c996', 'volume_name': 'volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.334889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d286f4-2761-4ce0-866a-cf0e1f325c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.337794 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d286f4-2761-4ce0-866a-cf0e1f325c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.340213 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed127b0-195c-48a9-8386-285119e9cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.341202 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume e85e14ab-0ae2-4153-91b2-021a2ea6c996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996', 'volume_size': 1} Nov 06 20:54:27.344099 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] creating volume 'volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:54:27.345507 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:54:27.473744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:54:27.474218 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:54:27.476918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ed127b0-195c-48a9-8386-285119e9cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.479170 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb0989-66f8-4f69-b4ed-e61bfbbe5e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:27.505907 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996 (e85e14ab-0ae2-4153-91b2-021a2ea6c996): created successfully Nov 06 20:54:27.508420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5abb0989-66f8-4f69-b4ed-e61bfbbe5e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:27.511691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Flow 'volume_create_manager' (cf6b7009-d9f8-4e0f-b36c-620248a62e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:54:27.528380 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e0a5dc46-148b-435c-998b-2ede2bc7c540 tempest-ServerRescueNegativeTestJSON-1374481399 None] Created volume successfully. Nov 06 20:54:57.491228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:54:57.508745 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:54:57.510448 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:54:57.544442 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Flow 'volume_create_manager' (3d600ffb-eb77-4058-9e4a-706d4c59a46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:54:57.551524 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f8c2b-839b-4262-bec4-77e3fcf5a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.565069 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:54:57.582708 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (475f8c2b-839b-4262-bec4-77e3fcf5a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-120949520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea858d8a-67d5-493c-a315-e50ce7efcabe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='046b2d11820348118cbe7a156018a1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:54:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:54:57Z,use_quota=True,user_id='2db226fb557e4c0aa2e15fcc8d7a488d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.586151 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7721d0f2-cfac-474d-b1b3-e055f215b988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.588724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7721d0f2-cfac-474d-b1b3-e055f215b988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.591284 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f586-97b0-4f3b-9243-0d390081b13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.595261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5d9f586-97b0-4f3b-9243-0d390081b13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea858d8a-67d5-493c-a315-e50ce7efcabe', 'volume_name': 'volume-ea858d8a-67d5-493c-a315-e50ce7efcabe', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.597826 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c0bb79-d5d5-437b-ba47-4c0211954f0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.601168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c0bb79-d5d5-437b-ba47-4c0211954f0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.603547 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de66724f-e252-4fdb-93c3-b246830ee51b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.604687 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume ea858d8a-67d5-493c-a315-e50ce7efcabe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea858d8a-67d5-493c-a315-e50ce7efcabe', 'volume_size': 1} Nov 06 20:54:57.605421 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] creating volume 'volume-ea858d8a-67d5-493c-a315-e50ce7efcabe' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:54:57.606627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:54:57.736422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:54:57.737062 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:54:57.739211 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de66724f-e252-4fdb-93c3-b246830ee51b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea858d8a-67d5-493c-a315-e50ce7efcabe', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.742390 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dec9c6-67fc-4086-a7ff-d4b1f4e0c7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:54:57.771066 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume volume-ea858d8a-67d5-493c-a315-e50ce7efcabe (ea858d8a-67d5-493c-a315-e50ce7efcabe): created successfully Nov 06 20:54:57.774633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24dec9c6-67fc-4086-a7ff-d4b1f4e0c7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:54:57.778864 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Flow 'volume_create_manager' (3d600ffb-eb77-4058-9e4a-706d4c59a46a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:54:57.805262 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-422720b1-8aa5-41ba-9e20-bfa2c051aa17 tempest-ServerRescueNegativeTestJSON-1374481399 None] Created volume successfully. Nov 06 20:55:00.880162 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-b251765d-714b-4531-952d-37dd6dffb88f req-275688e2-f8d8-4906-bf98-b31adbf79423 tempest-ServerRescueNegativeTestJSON-1374481399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:55:02.624458 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-b251765d-714b-4531-952d-37dd6dffb88f req-275688e2-f8d8-4906-bf98-b31adbf79423 tempest-ServerRescueNegativeTestJSON-1374481399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.744s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:55:02.626488 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b251765d-714b-4531-952d-37dd6dffb88f req-275688e2-f8d8-4906-bf98-b31adbf79423 tempest-ServerRescueNegativeTestJSON-1374481399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea858d8a-67d5-493c-a315-e50ce7efcabe', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ea858d8a-67d5-493c-a315-e50ce7efcabe', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:55:02.657124 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-b251765d-714b-4531-952d-37dd6dffb88f req-275688e2-f8d8-4906-bf98-b31adbf79423 tempest-ServerRescueNegativeTestJSON-1374481399 None] Connection info returned from driver {'name': 'volumes/volume-ea858d8a-67d5-493c-a315-e50ce7efcabe', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea858d8a-67d5-493c-a315-e50ce7efcabe', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7f9e8a4f-a400-45ff-9d5b-7ff32b55abde'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:55:02.765614 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-b251765d-714b-4531-952d-37dd6dffb88f req-275688e2-f8d8-4906-bf98-b31adbf79423 tempest-ServerRescueNegativeTestJSON-1374481399 None] attachment_update completed successfully. Nov 06 20:55:10.073330 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:55:10.075699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:10.183837 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:10.244425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:55:46.063198 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-829c11e0-b913-4910-9808-87341e226884 req-603749ca-a97a-49fb-ac54-ebce2740d44e tempest-ServerRescueNegativeTestJSON-1374481399 None] Terminate volume connection completed successfully. Nov 06 20:55:46.064474 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-829c11e0-b913-4910-9808-87341e226884 req-603749ca-a97a-49fb-ac54-ebce2740d44e tempest-ServerRescueNegativeTestJSON-1374481399 None] Deleting attachment 7f9e8a4f-a400-45ff-9d5b-7ff32b55abde. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:55:47.564278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Lock "b'cinder-ea858d8a-67d5-493c-a315-e50ce7efcabe-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:55:47.621553 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:47.704193 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:55:47.705040 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume volume-ea858d8a-67d5-493c-a315-e50ce7efcabe is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:55:47.721825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] deleting rbd volume volume-ea858d8a-67d5-493c-a315-e50ce7efcabe {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:55:48.184163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Created reservations ['a8536075-68d7-41cc-b105-bd434bbf8ee8', '4d39f775-e6bd-4a73-aef2-caaf014284d0', '710e431f-db63-470e-9062-6b8d418a0bf7', 'c9a87c3a-430d-4114-bd80-2cf54022df27'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:55:48.288546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:48.362220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:48.417467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:55:48.433303 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Deleted volume successfully. Nov 06 20:55:48.456089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0621cb12-476e-4426-9a5c-63aa8cf7fd46 tempest-ServerRescueNegativeTestJSON-1374481399 None] Lock "b'cinder-ea858d8a-67d5-493c-a315-e50ce7efcabe-delete_volume'" released by "delete_volume" :: held 0.893s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:55:48.810193 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Lock "b'cinder-e85e14ab-0ae2-4153-91b2-021a2ea6c996-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:55:48.909091 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:48.987130 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:55:48.987702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Volume volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:55:48.998193 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] deleting rbd volume volume-e85e14ab-0ae2-4153-91b2-021a2ea6c996 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:55:49.499494 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Created reservations ['eead76b2-56eb-4927-962b-b377d617e357', '00c9fab4-3141-4169-9af6-d7d5c7d2b62c', '06208887-4dfc-4b25-925a-f2526de23040', '033086cf-d8e2-4710-8dc7-1dad3716bda5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:55:49.626960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:49.718580 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:55:49.780075 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:55:49.784056 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Deleted volume successfully. Nov 06 20:55:49.805469 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-23d576a6-f447-4a02-988a-c8273a63ecc9 tempest-ServerRescueNegativeTestJSON-1374481399 None] Lock "b'cinder-e85e14ab-0ae2-4153-91b2-021a2ea6c996-delete_volume'" released by "delete_volume" :: held 0.999s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:56:10.073430 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:56:10.074077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:56:10.131026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:56:10.243290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:56:15.907516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:56:15.920543 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:56:15.924168 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:56:15.948460 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Flow 'volume_create_manager' (3114f549-33a4-44e5-8c65-6778d8925c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:56:15.953766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c36d63-7e25-4786-bb05-530fa49c4b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:15.968931 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:56:15.993674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c36d63-7e25-4786-bb05-530fa49c4b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:56:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveAutoBlockMigrationV225Test-volume-673734296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=fa98b723-a4ea-4a19-a28c-a7cff197c3af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c383d3827904548a85fe5db914aee4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:56:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:56:16Z,use_quota=True,user_id='2b4178344ec541bb964ed60d977eff68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:15.997654 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c4ed2-6c88-4be0-a640-cf62e9793941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:16.000053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (520c4ed2-6c88-4be0-a640-cf62e9793941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:16.003386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a916acef-6ad8-4e45-863a-1bb62929dce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:16.009944 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a916acef-6ad8-4e45-863a-1bb62929dce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'volume_name': 'volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:16.012194 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0ad683-f208-4c60-8a95-c0cc4ac995c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:16.023053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a0ad683-f208-4c60-8a95-c0cc4ac995c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:16.025355 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b0f9d9-9ca4-4716-879d-8219a06e16b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:16.026164 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume fa98b723-a4ea-4a19-a28c-a7cff197c3af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'volume_size': 1} Nov 06 20:56:16.026556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] creating volume 'volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:56:16.027570 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:56:16.122544 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:56:16.123246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:56:16.125986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46b0f9d9-9ca4-4716-879d-8219a06e16b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:16.129316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffe4ce-1bfb-41f4-bf32-3fa80316970f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:16.149345 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af (fa98b723-a4ea-4a19-a28c-a7cff197c3af): created successfully Nov 06 20:56:16.152579 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffe4ce-1bfb-41f4-bf32-3fa80316970f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:16.156767 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Flow 'volume_create_manager' (3114f549-33a4-44e5-8c65-6778d8925c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:56:16.171293 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c7c3b25c-f766-4b31-baaa-c77f35063a37 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Created volume successfully. Nov 06 20:56:17.606011 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 req-4609df56-3f50-4051-98b5-4511b6bceb84 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:56:18.293343 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 req-4609df56-3f50-4051-98b5-4511b6bceb84 tempest-LiveAutoBlockMigrationV225Test-92513929 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:56:18.294067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 req-4609df56-3f50-4051-98b5-4511b6bceb84 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:56:18.321467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 req-4609df56-3f50-4051-98b5-4511b6bceb84 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Connection info returned from driver {'name': 'volumes/volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '95ebf225-71b5-4ea2-88ba-d191bc70e677'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:56:18.379499 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-b3e2e6f7-7a42-4e59-b7a7-d922b5a68d32 req-4609df56-3f50-4051-98b5-4511b6bceb84 tempest-LiveAutoBlockMigrationV225Test-92513929 None] attachment_update completed successfully. Nov 06 20:56:25.409302 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-da528292-447a-4c31-84e1-acd370abac1b tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:56:26.384770 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-da528292-447a-4c31-84e1-acd370abac1b tempest-LiveAutoBlockMigrationV225Test-2030327405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.975s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:56:26.386073 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-da528292-447a-4c31-84e1-acd370abac1b tempest-LiveAutoBlockMigrationV225Test-2030327405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:56:26.417524 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-da528292-447a-4c31-84e1-acd370abac1b tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Connection info returned from driver {'name': 'volumes/volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'fa98b723-a4ea-4a19-a28c-a7cff197c3af', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'c0a6b25e-6392-4f32-a64b-812658cd6f67'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:56:26.492187 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-da528292-447a-4c31-84e1-acd370abac1b tempest-LiveAutoBlockMigrationV225Test-2030327405 None] attachment_update completed successfully. Nov 06 20:56:38.332957 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-9b1bec82-d935-4e20-907f-cd2f22e6c6d7 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Terminate volume connection completed successfully. Nov 06 20:56:38.333659 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e1e9b5ee-f0f6-4f1c-ba96-111c45fc9846 req-9b1bec82-d935-4e20-907f-cd2f22e6c6d7 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Deleting attachment 95ebf225-71b5-4ea2-88ba-d191bc70e677. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:56:44.850443 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-64bfd242-0000-4b5e-8862-570cfce6ddd7 req-309cb931-57f5-4b7c-974a-ca30cba3379e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Terminate volume connection completed successfully. Nov 06 20:56:44.851092 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-64bfd242-0000-4b5e-8862-570cfce6ddd7 req-309cb931-57f5-4b7c-974a-ca30cba3379e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deleting attachment c0a6b25e-6392-4f32-a64b-812658cd6f67. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:56:46.461205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:56:46.485717 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:56:46.486241 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:56:46.515812 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Flow 'volume_create_manager' (1a3c8cb5-1c03-4b1e-adef-b2a6aee0b31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:56:46.519096 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d1af5d-7cf1-4f91-b94c-80497b454517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:46.532756 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:56:46.567454 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d1af5d-7cf1-4f91-b94c-80497b454517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1825882644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=66f9752d-e592-4a5a-b333-de1426b182d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c383d3827904548a85fe5db914aee4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:56:46Z,use_quota=True,user_id='2b4178344ec541bb964ed60d977eff68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:46.572392 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd99983-8b96-447f-afda-95595716b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:46.579161 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd99983-8b96-447f-afda-95595716b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:46.588945 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01104ac6-9421-4483-a3f7-f4a064d770e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:46.719970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01104ac6-9421-4483-a3f7-f4a064d770e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '66f9752d-e592-4a5a-b333-de1426b182d0', 'volume_name': 'volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:46.724520 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1864b9f8-6063-48da-9205-cb73cb121ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:46.728183 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1864b9f8-6063-48da-9205-cb73cb121ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:46.738830 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867ae38-fcb4-4159-956a-ad97dcae98da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:46.739569 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume 66f9752d-e592-4a5a-b333-de1426b182d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 20:56:46.741107 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Cloning 66f9752d-e592-4a5a-b333-de1426b182d0 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 20:56:46.752910 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:56:46.766975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 20, 56, 46, 757397)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 20:56:46.767887 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 20:56:46.768555 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 20:56:46.775074 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:56:46.776236 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 20:56:46.785193 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 20, 56, 46, 780685)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 20:56:46.785852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 20:56:46.786444 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 20:56:46.800991 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:56:46.953227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] creating snapshot='volume-66f9752d-e592-4a5a-b333-de1426b182d0.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 20:56:48.027493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-66f9752d-e592-4a5a-b333-de1426b182d0.clone_snap' to 'volume-66f9752d-e592-4a5a-b333-de1426b182d0' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 20:56:48.219820 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:56:48.229979 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:56:48.229979 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:56:48.257813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 20:56:48.258849 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Marking volume 66f9752d-e592-4a5a-b333-de1426b182d0 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 20:56:48.282310 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 66f9752d-e592-4a5a-b333-de1426b182d0. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 20:56:48.282963 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Creating volume glance metadata for volume 66f9752d-e592-4a5a-b333-de1426b182d0 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 20:56:48.375714 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5867ae38-fcb4-4159-956a-ad97dcae98da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:48.378468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446fd7c2-5f7b-4c78-bfee-c57e840a2d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:56:48.400468 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume volume-66f9752d-e592-4a5a-b333-de1426b182d0 (66f9752d-e592-4a5a-b333-de1426b182d0): created successfully Nov 06 20:56:48.405985 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (446fd7c2-5f7b-4c78-bfee-c57e840a2d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:56:48.417790 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Flow 'volume_create_manager' (1a3c8cb5-1c03-4b1e-adef-b2a6aee0b31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:56:48.437290 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-90c9df00-e299-4c72-b94e-66bb23edf389 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Created volume successfully. Nov 06 20:56:51.497031 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-5c28cdb2-f4e5-4249-870c-539a99f256ac req-96738312-74ac-48dd-b0f5-f24ad389e216 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:56:52.365783 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-5c28cdb2-f4e5-4249-870c-539a99f256ac req-96738312-74ac-48dd-b0f5-f24ad389e216 tempest-LiveAutoBlockMigrationV225Test-92513929 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.868s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:56:52.366577 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-5c28cdb2-f4e5-4249-870c-539a99f256ac req-96738312-74ac-48dd-b0f5-f24ad389e216 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '66f9752d-e592-4a5a-b333-de1426b182d0', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:56:52.412443 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-5c28cdb2-f4e5-4249-870c-539a99f256ac req-96738312-74ac-48dd-b0f5-f24ad389e216 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Connection info returned from driver {'name': 'volumes/volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '66f9752d-e592-4a5a-b333-de1426b182d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '19aa26f0-7564-4f98-9a93-7786900be068'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:56:52.478668 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-5c28cdb2-f4e5-4249-870c-539a99f256ac req-96738312-74ac-48dd-b0f5-f24ad389e216 tempest-LiveAutoBlockMigrationV225Test-92513929 None] attachment_update completed successfully. Nov 06 20:57:10.078851 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:57:10.079889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:10.134521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:10.210856 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:57:15.464117 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-290a94b1-38cb-4660-96a9-161b136da79e req-e8ccde50-4972-4f35-8075-8b80d8909b44 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:57:16.644219 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-290a94b1-38cb-4660-96a9-161b136da79e req-e8ccde50-4972-4f35-8075-8b80d8909b44 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.180s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:57:16.646283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-290a94b1-38cb-4660-96a9-161b136da79e req-e8ccde50-4972-4f35-8075-8b80d8909b44 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '66f9752d-e592-4a5a-b333-de1426b182d0', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:57:16.724698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-290a94b1-38cb-4660-96a9-161b136da79e req-e8ccde50-4972-4f35-8075-8b80d8909b44 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Connection info returned from driver {'name': 'volumes/volume-66f9752d-e592-4a5a-b333-de1426b182d0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '66f9752d-e592-4a5a-b333-de1426b182d0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a5833ec7-e64f-4a7b-9e34-6300cb213dfc'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:57:16.854195 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-290a94b1-38cb-4660-96a9-161b136da79e req-e8ccde50-4972-4f35-8075-8b80d8909b44 tempest-LiveAutoBlockMigrationV225Test-2030327405 None] attachment_update completed successfully. Nov 06 20:57:27.986713 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-290a94b1-38cb-4660-96a9-161b136da79e req-6fc0b6cf-2e42-4257-9c4d-aaea0049aa3d tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Terminate volume connection completed successfully. Nov 06 20:57:27.987891 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-290a94b1-38cb-4660-96a9-161b136da79e req-6fc0b6cf-2e42-4257-9c4d-aaea0049aa3d tempest-LiveAutoBlockMigrationV225Test-2030327405 None] Deleting attachment 19aa26f0-7564-4f98-9a93-7786900be068. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:57:34.738308 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-b778a697-50cd-41c9-9259-ebdaa44c162e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Terminate volume connection completed successfully. Nov 06 20:57:34.738949 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-b778a697-50cd-41c9-9259-ebdaa44c162e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deleting attachment a5833ec7-e64f-4a7b-9e34-6300cb213dfc. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:57:34.878880 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-66f9752d-e592-4a5a-b333-de1426b182d0-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:57:34.943113 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:35.066073 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:57:35.081513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] deleting rbd volume volume-66f9752d-e592-4a5a-b333-de1426b182d0 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:57:35.478897 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 20:57:35.518503 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] deleting parent snapshot volume-66f9752d-e592-4a5a-b333-de1426b182d0.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 20:57:36.633716 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-fa98b723-a4ea-4a19-a28c-a7cff197c3af-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:57:36.644079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Created reservations ['aa710684-1aaf-4b63-856a-31b571c835bb', 'e44c0ce9-2e34-47a5-b427-869de105b42c', 'e59da128-e119-4989-a975-50f81246f51c', '74accc07-1b73-415b-bab7-51f4be41ecbf'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:57:36.700179 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:36.786517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:57:36.787270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Volume volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:57:36.798350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] deleting rbd volume volume-fa98b723-a4ea-4a19-a28c-a7cff197c3af {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:57:36.897295 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:36.979263 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:37.059185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:57:37.069488 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deleted volume successfully. Nov 06 20:57:37.106484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-018bcbea-db44-459a-bcbd-3aa8f8106349 req-8e18c5ae-6ff8-4d13-b1f5-07571b39c289 tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-66f9752d-e592-4a5a-b333-de1426b182d0-delete_volume'" released by "delete_volume" :: held 2.228s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:57:37.243056 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Created reservations ['c11ee6c0-fd61-48e3-b711-ab66d1564ec4', 'e3172ac9-560e-49bf-80c6-9e467d944752', '7e5f916e-6459-498b-b874-f2a387be009d', '0fccdb79-a3a4-49f8-8e04-87eedd8df8d3'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:57:37.327876 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:37.397807 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:37.480312 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:57:37.484470 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Deleted volume successfully. Nov 06 20:57:37.512168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0c9a527d-26a5-42a6-bb15-f9a98f33c34e tempest-LiveAutoBlockMigrationV225Test-92513929 None] Lock "b'cinder-fa98b723-a4ea-4a19-a28c-a7cff197c3af-delete_volume'" released by "delete_volume" :: held 0.879s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:57:44.099737 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:57:44.107217 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:57:44.108039 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:57:44.126093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Flow 'volume_create_manager' (be7fc883-5e63-41da-9483-0f1e8cea5b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:57:44.132467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2efe672-97d3-4ca0-a5ba-1874cb92066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.140743 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:57:44.160633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2efe672-97d3-4ca0-a5ba-1874cb92066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2141876810',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=009aa4f5-f40b-4281-b200-5544181221dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0abfd854dfe46acaeedf288c6674c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:57:44Z,use_quota=True,user_id='6f17807a206f49a1a165fe77aec4468c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.167634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e690617e-cece-41c0-a613-b40c68d12e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.170601 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e690617e-cece-41c0-a613-b40c68d12e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.174546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adbdef1-66d8-4a99-840b-7387c2214a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.179021 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7adbdef1-66d8-4a99-840b-7387c2214a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009aa4f5-f40b-4281-b200-5544181221dc', 'volume_name': 'volume-009aa4f5-f40b-4281-b200-5544181221dc', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.183026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d04a59-ed12-4ee2-b713-42c3a95e41af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.185181 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37d04a59-ed12-4ee2-b713-42c3a95e41af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.201026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316b9004-69c5-42de-bb72-8ccea07d343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.201908 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Volume 009aa4f5-f40b-4281-b200-5544181221dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009aa4f5-f40b-4281-b200-5544181221dc', 'volume_size': 1} Nov 06 20:57:44.202323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] creating volume 'volume-009aa4f5-f40b-4281-b200-5544181221dc' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:57:44.203831 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:57:44.326933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:57:44.327729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:57:44.330678 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (316b9004-69c5-42de-bb72-8ccea07d343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009aa4f5-f40b-4281-b200-5544181221dc', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.333207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff14147a-c39b-4a1b-8c73-e3283d7a603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:57:44.349242 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Volume volume-009aa4f5-f40b-4281-b200-5544181221dc (009aa4f5-f40b-4281-b200-5544181221dc): created successfully Nov 06 20:57:44.351629 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff14147a-c39b-4a1b-8c73-e3283d7a603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:57:44.355026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Flow 'volume_create_manager' (be7fc883-5e63-41da-9483-0f1e8cea5b48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:57:44.375548 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9df91beb-ff84-4dc0-9e3a-49b1718fbe0b tempest-AttachVolumeShelveTestJSON-860784193 None] Created volume successfully. Nov 06 20:58:03.117040 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:03.121706 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:03.122202 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:03.136464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Flow 'volume_create_manager' (36bff2f0-0c8a-482d-ae7b-92820eb26771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:03.139776 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c80014c-26b2-4d33-b672-2842b79dd91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.147643 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:03.168084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c80014c-26b2-4d33-b672-2842b79dd91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1373853639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81320b99746a4f9b84dde57142855f51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:03Z,use_quota=True,user_id='acadb7f94a1649abad446523b5770b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.173647 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade45529-920e-4ed1-a82d-fab6cc0fc540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.176235 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade45529-920e-4ed1-a82d-fab6cc0fc540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.179170 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258bf63a-2246-4037-9383-7a578192bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.181660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (258bf63a-2246-4037-9383-7a578192bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b', 'volume_name': 'volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.184380 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3defbcf8-2df0-449b-9825-5b3f512f4ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.186715 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3defbcf8-2df0-449b-9825-5b3f512f4ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.189337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9bf813-acb3-49b6-a3d5-8d86aa677bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.190392 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Volume ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b', 'volume_size': 1} Nov 06 20:58:03.190965 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] creating volume 'volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:03.192192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:03.362139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:03.362842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:03.365316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9bf813-acb3-49b6-a3d5-8d86aa677bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.367691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d83a4bb-9da4-4e6a-9af6-ca26e0eb9ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:03.385583 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Volume volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b (ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b): created successfully Nov 06 20:58:03.391147 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d83a4bb-9da4-4e6a-9af6-ca26e0eb9ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:03.395267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Flow 'volume_create_manager' (36bff2f0-0c8a-482d-ae7b-92820eb26771) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:03.413812 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e5f819f9-9489-4816-a65e-6e8211e2735f tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Created volume successfully. Nov 06 20:58:05.083813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Lock "b'cinder-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:05.149214 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:05.241055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:58:05.241649 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Volume volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:05.255620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] deleting rbd volume volume-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:58:05.560223 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Created reservations ['02135f9f-1a92-4836-b379-7c79dffbf11c', '8729ed32-74d5-4a17-b522-1c976dd4a53f', '01575bd8-5015-4435-8d94-e97e1f9e3ade', '8886680f-456f-48c2-a740-043977557437'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:05.614821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:05.686442 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:05.746225 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:05.754423 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Deleted volume successfully. Nov 06 20:58:05.772620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-459c4fbd-f611-4d57-b6bc-5a6671f34126 tempest-VolumeQuotasNegativeTestJSON-1540554919 None] Lock "b'cinder-ec356d35-5a07-47e3-ab27-7ac5c4ee5f0b-delete_volume'" released by "delete_volume" :: held 0.689s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:10.083147 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:58:10.084664 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:10.150954 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:10.226005 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:12.632556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:12.636666 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:12.637289 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:12.649710 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Flow 'volume_create_manager' (01dd632d-1b93-4fa1-8de0-fea7e3dc0a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:12.653243 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79a5828-1e09-48fa-8bae-09cd36f65a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.661055 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:12.677626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b79a5828-1e09-48fa-8bae-09cd36f65a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-754617730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4365a58d-b288-473d-909f-a0877a7543fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ce322d953e4d2bbf8f869e961cbbc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:13Z,use_quota=True,user_id='e85e88dc5cb94e7383f9fe35f407974e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8326c6c8-8f8b-40ad-a926-a9b127543341),volume_type_id=8326c6c8-8f8b-40ad-a926-a9b127543341)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.680552 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0184bc4-4619-46e7-a912-382b28e97a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.682871 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0184bc4-4619-46e7-a912-382b28e97a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.685422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfbfe88-875e-430e-85ab-de30be5a6a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.688049 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfbfe88-875e-430e-85ab-de30be5a6a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4365a58d-b288-473d-909f-a0877a7543fc', 'volume_name': 'volume-4365a58d-b288-473d-909f-a0877a7543fc', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.690293 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9945508b-b00f-42eb-be6b-d24be79a64d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.692336 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9945508b-b00f-42eb-be6b-d24be79a64d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.694734 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eeb5e76-0101-4518-8b46-83f56cc8ffb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.695440 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Volume 4365a58d-b288-473d-909f-a0877a7543fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4365a58d-b288-473d-909f-a0877a7543fc', 'volume_size': 1} Nov 06 20:58:12.695998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] creating volume 'volume-4365a58d-b288-473d-909f-a0877a7543fc' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:12.697022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:12.797895 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:12.799207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:12.801420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eeb5e76-0101-4518-8b46-83f56cc8ffb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4365a58d-b288-473d-909f-a0877a7543fc', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.807186 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86980a7a-066f-49df-83fe-f1e717fecbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:12.817402 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Volume volume-4365a58d-b288-473d-909f-a0877a7543fc (4365a58d-b288-473d-909f-a0877a7543fc): created successfully Nov 06 20:58:12.824158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86980a7a-066f-49df-83fe-f1e717fecbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:12.828640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Flow 'volume_create_manager' (01dd632d-1b93-4fa1-8de0-fea7e3dc0a96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:12.850576 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1c1f63a9-7ec9-419b-8463-15660d477051 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Created volume successfully. Nov 06 20:58:14.218036 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-082d427f-da44-423b-a8a7-a6c992dace9e tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:14.296993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-082d427f-da44-423b-a8a7-a6c992dace9e tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:14.369754 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-082d427f-da44-423b-a8a7-a6c992dace9e tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:14.377223 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-082d427f-da44-423b-a8a7-a6c992dace9e tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Retype volume completed successfully. Nov 06 20:58:15.354705 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Lock "b'cinder-4365a58d-b288-473d-909f-a0877a7543fc-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:15.399278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:15.477259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:58:15.477899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Volume volume-4365a58d-b288-473d-909f-a0877a7543fc is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:15.485347 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] deleting rbd volume volume-4365a58d-b288-473d-909f-a0877a7543fc {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:58:15.785735 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:58:15.788429 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:58:15.837491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Created reservations ['e2859c1d-e5a9-4963-9cae-e05055c5d122', 'a56dab1c-e33e-4f8f-8e34-f2c985455860', 'a027035a-15f4-4cbd-aafc-f0e01da0b4fa', 'a1f76050-ce46-4178-8a78-fd78d1ab618e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:15.985775 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:16.054476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:16.085139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:16.089993 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Deleted volume successfully. Nov 06 20:58:16.108970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8ca0c2fd-548e-4039-987c-c9abd939dec7 tempest-VolumeRetypeWithoutMigrationTest-1106950200 None] Lock "b'cinder-4365a58d-b288-473d-909f-a0877a7543fc-delete_volume'" released by "delete_volume" :: held 0.754s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:25.809674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:25.815540 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:25.815943 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:25.842601 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Flow 'volume_create_manager' (ae362658-542f-4005-ab02-7007aee09a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:25.845764 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d0b328-ae90-460e-88be-1af526f9628a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:25.862013 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:25.895786 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2d0b328-ae90-460e-88be-1af526f9628a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-406197315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=acd0d0dd-50a8-4d7d-87db-47319eb75bfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f30b7876b4884770be92cd7c6f2d6268',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:26Z,use_quota=True,user_id='2603421c519c4d5e92e2096a0cd276e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(972023af-a50a-413b-85e9-51a48b79c727),volume_type_id=972023af-a50a-413b-85e9-51a48b79c727)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:25.900266 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da110cd8-dbb8-4b72-8d59-4b16fe188d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:25.915268 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da110cd8-dbb8-4b72-8d59-4b16fe188d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:25.919014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6491a8-9c07-4259-bc15-75cb03f08b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:25.927457 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd6491a8-9c07-4259-bc15-75cb03f08b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acd0d0dd-50a8-4d7d-87db-47319eb75bfd', 'volume_name': 'volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:25.933993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5ea93b-fbfe-4080-b767-3384cc72c714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:25.939160 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc5ea93b-fbfe-4080-b767-3384cc72c714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:25.943496 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d3e545-d987-4e56-97a3-1adf521e8649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:25.946110 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Volume acd0d0dd-50a8-4d7d-87db-47319eb75bfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd', 'volume_size': 1} Nov 06 20:58:25.947309 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] creating volume 'volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:25.948446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:26.081399 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:26.082567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:26.084708 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57d3e545-d987-4e56-97a3-1adf521e8649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:26.087166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0ebfb9-4841-4f56-8689-f2e633f77b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:26.106182 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Volume volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd (acd0d0dd-50a8-4d7d-87db-47319eb75bfd): created successfully Nov 06 20:58:26.110750 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac0ebfb9-4841-4f56-8689-f2e633f77b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:26.118992 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Flow 'volume_create_manager' (ae362658-542f-4005-ab02-7007aee09a27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:26.137101 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8d19f1d2-97e5-470a-8bd8-e4e9b8e511aa tempest-VolumeTypesAccessTest-738052813 None] Created volume successfully. Nov 06 20:58:27.405117 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Lock "b'cinder-acd0d0dd-50a8-4d7d-87db-47319eb75bfd-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:27.459694 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:27.586951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:58:27.606917 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Volume volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:27.620217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] deleting rbd volume volume-acd0d0dd-50a8-4d7d-87db-47319eb75bfd {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:58:28.043647 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1433207474 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1433207474, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:58:28.058129 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1433207474 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1433207474, it is now deprecated. Please use the default quota class for default quota. Nov 06 20:58:28.097580 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Created reservations ['7624d3a0-c562-4330-be2f-5609352deb22', 'ea2dd784-cf31-48f8-97c4-f08006493bd8', '46c3f6f2-ce65-48e6-a3bc-c186f97e7e5d', '9ad6039c-eefe-481c-8849-98bbc794d0d7'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:28.191150 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:28.263487 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:28.325735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:28.330821 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Deleted volume successfully. Nov 06 20:58:28.350248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4e115591-37cf-45b0-8ef3-3b77630cbf5e tempest-VolumeTypesAccessTest-738052813 None] Lock "b'cinder-acd0d0dd-50a8-4d7d-87db-47319eb75bfd-delete_volume'" released by "delete_volume" :: held 0.945s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:34.989143 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-11666e98-3579-4bb6-9327-c1994db1f67b req-c9bcd622-824e-49f2-97ee-4e39b2c84cea tempest-AttachVolumeShelveTestJSON-860784193 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:58:36.179902 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:36.185080 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:36.185653 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:36.216236 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Flow 'volume_create_manager' (e83f1b96-e74f-476c-9776-da4149c6f27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:36.224166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a91b82-c9f1-4471-82af-9f0ea55a4f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.236168 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:36.237102 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-11666e98-3579-4bb6-9327-c1994db1f67b req-c9bcd622-824e-49f2-97ee-4e39b2c84cea tempest-AttachVolumeShelveTestJSON-860784193 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.248s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:58:36.237933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-11666e98-3579-4bb6-9327-c1994db1f67b req-c9bcd622-824e-49f2-97ee-4e39b2c84cea tempest-AttachVolumeShelveTestJSON-860784193 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-009aa4f5-f40b-4281-b200-5544181221dc', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '009aa4f5-f40b-4281-b200-5544181221dc', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:58:36.272919 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83a91b82-c9f1-4471-82af-9f0ea55a4f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1472178731',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=48985633-ae0b-4805-88d2-89461805cc02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c472d72601344548fbea285081d2ca1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:36Z,use_quota=True,user_id='405bd0aadf0646eaae5d8fd5649b3c0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.275535 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f57c4d-020c-46f5-8e9f-6bc25a84252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.277621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03f57c4d-020c-46f5-8e9f-6bc25a84252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.280033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d34d095-6637-4b94-a919-5d5b7abedce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.282622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d34d095-6637-4b94-a919-5d5b7abedce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48985633-ae0b-4805-88d2-89461805cc02', 'volume_name': 'volume-48985633-ae0b-4805-88d2-89461805cc02', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.284839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30be0a66-7b08-403f-af32-6fba51e239f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.286896 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30be0a66-7b08-403f-af32-6fba51e239f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.289334 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad05850a-8930-4897-9335-043035f2792d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.290292 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Volume 48985633-ae0b-4805-88d2-89461805cc02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48985633-ae0b-4805-88d2-89461805cc02', 'volume_size': 1} Nov 06 20:58:36.290694 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] creating volume 'volume-48985633-ae0b-4805-88d2-89461805cc02' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:36.292036 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:36.360502 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-11666e98-3579-4bb6-9327-c1994db1f67b req-c9bcd622-824e-49f2-97ee-4e39b2c84cea tempest-AttachVolumeShelveTestJSON-860784193 None] Connection info returned from driver {'name': 'volumes/volume-009aa4f5-f40b-4281-b200-5544181221dc', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '009aa4f5-f40b-4281-b200-5544181221dc', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'a7674afc-e9c6-4fbb-8c23-12d5375dfd02'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:58:36.409711 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:36.417025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:36.417025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad05850a-8930-4897-9335-043035f2792d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48985633-ae0b-4805-88d2-89461805cc02', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.417432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c84d001-abdc-4dbf-b1a4-e5c7f484e574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:36.447104 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Volume volume-48985633-ae0b-4805-88d2-89461805cc02 (48985633-ae0b-4805-88d2-89461805cc02): created successfully Nov 06 20:58:36.449580 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c84d001-abdc-4dbf-b1a4-e5c7f484e574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:36.453136 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Flow 'volume_create_manager' (e83f1b96-e74f-476c-9776-da4149c6f27c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:36.467712 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-11666e98-3579-4bb6-9327-c1994db1f67b req-c9bcd622-824e-49f2-97ee-4e39b2c84cea tempest-AttachVolumeShelveTestJSON-860784193 None] attachment_update completed successfully. Nov 06 20:58:36.475454 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-27234dbf-26c7-406a-a5dc-7a333eb7b7c4 tempest-SnapshotMetadataTestJSON-640296506 None] Created volume successfully. Nov 06 20:58:37.504518 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ed76b28-d65e-4d1e-8254-71dc2126a8f3 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:38.205319 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7ed76b28-d65e-4d1e-8254-71dc2126a8f3 tempest-SnapshotMetadataTestJSON-640296506 None] Create snapshot completed successfully Nov 06 20:58:39.469795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e43368d-c562-4bc0-a8af-58f61e5d72c1 tempest-SnapshotMetadataTestJSON-640296506 None] Lock "b'cinder-a8176f1c-1f59-418c-9ed3-c3ef75fe9952-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.026s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:39.473499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e43368d-c562-4bc0-a8af-58f61e5d72c1 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:40.322920 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0e43368d-c562-4bc0-a8af-58f61e5d72c1 tempest-SnapshotMetadataTestJSON-640296506 None] Created reservations ['42da069d-392b-4275-ac6b-98d197dacb71', '6e50876e-2182-4775-b02f-36271fcc67c1', 'e50d0464-e2b7-4343-80ea-7e351bd310f6', '355ac491-bd88-4ebf-9b3c-6ff20c9be381'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:40.408839 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0e43368d-c562-4bc0-a8af-58f61e5d72c1 tempest-SnapshotMetadataTestJSON-640296506 None] Delete snapshot completed successfully. Nov 06 20:58:40.416386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e43368d-c562-4bc0-a8af-58f61e5d72c1 tempest-SnapshotMetadataTestJSON-640296506 None] Lock "b'cinder-a8176f1c-1f59-418c-9ed3-c3ef75fe9952-delete_snapshot'" released by "delete_snapshot" :: held 0.948s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:40.579179 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Lock "b'cinder-48985633-ae0b-4805-88d2-89461805cc02-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:40.660464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:40.747379 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:58:40.748163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Volume volume-48985633-ae0b-4805-88d2-89461805cc02 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:40.764543 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] deleting rbd volume volume-48985633-ae0b-4805-88d2-89461805cc02 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:58:41.176187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Created reservations ['acf4d9f5-9855-4e35-a1c5-4b098674d8cf', '79453a63-5cd8-4528-8f61-3d66b5cbd417', '08feb6f4-ddd2-4759-acb3-8efcb837997a', 'f4e4c559-a363-4e9a-9386-a4d413490f94'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:41.254103 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:41.302757 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:41.365138 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:41.368923 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Deleted volume successfully. Nov 06 20:58:41.387093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a5d5eaf2-0fc2-4288-8a04-1426a2e1b222 tempest-SnapshotMetadataTestJSON-640296506 None] Lock "b'cinder-48985633-ae0b-4805-88d2-89461805cc02-delete_volume'" released by "delete_volume" :: held 0.810s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:44.904414 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:44.911302 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:44.911835 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:44.928845 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Flow 'volume_create_manager' (de3281fd-8fb3-4065-9115-6a3774521290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:44.933376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a4e27a-f6dd-45f3-a13e-476296348e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:44.945485 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:44.969048 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2a4e27a-f6dd-45f3-a13e-476296348e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1131148292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=73abee75-12f8-41bd-819e-7cef5d8f4ba7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3ef27e965ce442e8559d007d372d2c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:45Z,use_quota=True,user_id='14b65c1a57964552bb65f99b13e728e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:44.976872 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919ea034-98cd-4e75-bf72-5b5c87afbc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:44.979365 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (919ea034-98cd-4e75-bf72-5b5c87afbc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:44.988433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7f206a-85e1-493a-9827-20a77ff7434f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:44.997698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c7f206a-85e1-493a-9827-20a77ff7434f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73abee75-12f8-41bd-819e-7cef5d8f4ba7', 'volume_name': 'volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:45.001270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67890b36-aa5b-49c7-a4fb-cd3f741ffc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:45.006208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67890b36-aa5b-49c7-a4fb-cd3f741ffc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:45.013031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed76880b-2eb2-41cf-a16b-c59ae84c43de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:45.017042 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Volume 73abee75-12f8-41bd-819e-7cef5d8f4ba7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7', 'volume_size': 1} Nov 06 20:58:45.019147 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] creating volume 'volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:45.020276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:45.131596 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:45.132555 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:45.134714 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed76880b-2eb2-41cf-a16b-c59ae84c43de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:45.146919 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0405f366-7c1a-4b48-9ec9-487ff272e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:45.160241 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Volume volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7 (73abee75-12f8-41bd-819e-7cef5d8f4ba7): created successfully Nov 06 20:58:45.168006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0405f366-7c1a-4b48-9ec9-487ff272e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:45.171590 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Flow 'volume_create_manager' (de3281fd-8fb3-4065-9115-6a3774521290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:45.194337 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b8bf7b9f-bf55-4e5b-a3ee-6d81f138a8f8 tempest-VolumesDeleteCascade-1607527484 None] Created volume successfully. Nov 06 20:58:46.074970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-71d2cca8-defe-4683-bc97-4a98e6640fbd tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:47.226985 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-71d2cca8-defe-4683-bc97-4a98e6640fbd tempest-VolumesDeleteCascade-1607527484 None] Create snapshot completed successfully Nov 06 20:58:48.257506 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf9fd102-3fc7-4ae6-b1be-5bc960f8d853 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:49.267021 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bf9fd102-3fc7-4ae6-b1be-5bc960f8d853 tempest-VolumesDeleteCascade-1607527484 None] Create snapshot completed successfully Nov 06 20:58:50.398829 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-73abee75-12f8-41bd-819e-7cef5d8f4ba7-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:50.472175 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Performing cascade delete. {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/manager.py:959}} Nov 06 20:58:50.525686 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-0468170c-dbdd-44c4-9dc4-d60a665b0be6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.019s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:50.539907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:51.282568 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Created reservations ['222573f5-49aa-4b50-a4de-cb8f4a321921', 'df7c59d7-4979-4be7-9cf7-f65590909ef4', 'b4261723-44b4-43b3-8bce-66c8bbf209f3', '53c630e8-d931-439b-830e-279147ce5e10'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:51.346519 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Delete snapshot completed successfully. Nov 06 20:58:51.362510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-0468170c-dbdd-44c4-9dc4-d60a665b0be6-delete_snapshot'" released by "delete_snapshot" :: held 0.832s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:51.373667 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-666e7799-09a8-42db-b78e-0bcd2415591c-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:51.386552 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:52.346189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Created reservations ['368bf52f-eb85-4198-86b6-f6cc44708828', '2439b847-5eb5-4aa2-aeda-a53e65b48d49', '886c7458-152b-48bb-9b0c-3eb40fd40db9', '0495937e-0c0b-4067-bee9-c32261e950d5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:52.402478 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Delete snapshot completed successfully. Nov 06 20:58:52.408952 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-666e7799-09a8-42db-b78e-0bcd2415591c-delete_snapshot'" released by "delete_snapshot" :: held 1.035s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:52.409801 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Snapshots deleted, issuing volume delete {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/manager.py:974}} Nov 06 20:58:52.410924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:52.508661 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:58:52.509256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Volume volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:52.528129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] deleting rbd volume volume-73abee75-12f8-41bd-819e-7cef5d8f4ba7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:58:52.897388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Created reservations ['3d7af27b-69d4-4368-acfe-3664f1a5d837', 'e1ee2e2c-d82a-4de1-b5af-caaab83ec1f3', 'ab8d9b44-7b4c-4b54-bad4-05f8af6bac7f', '8bf8fb81-dab7-4926-a645-ce514d4ed9ed'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:58:52.942351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:52.967762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:53.048599 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:58:53.069041 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Deleted volume successfully. Nov 06 20:58:53.103072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd23726d-91b2-48f4-940e-8307f63c5f42 tempest-VolumesDeleteCascade-1607527484 None] Lock "b'cinder-73abee75-12f8-41bd-819e-7cef5d8f4ba7-delete_volume'" released by "delete_volume" :: held 2.704s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:55.856474 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:55.873371 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:55.874077 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:55.886961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Flow 'volume_create_manager' (f42fd54a-d8bf-4daf-8285-87fe3d8ae02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:55.890210 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9943bf90-1be3-4305-b39c-f08847a78d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:55.897102 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:55.911668 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9943bf90-1be3-4305-b39c-f08847a78d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1729913986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c6d677d-3b5f-4655-967c-e961c02e6b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e9bba0db4c457594a2f4b31a7dc9b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:58:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:58:56Z,use_quota=True,user_id='cce6d29faec5406cb9b3566d827e3cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:55.914426 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4506ed-200c-4d59-87e0-f848492d3632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:55.917190 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4506ed-200c-4d59-87e0-f848492d3632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:55.922132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc5512-abc6-4700-b944-ff548052e5a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:56.011706 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dc5512-abc6-4700-b944-ff548052e5a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0c6d677d-3b5f-4655-967c-e961c02e6b40', 'volume_name': 'volume-0c6d677d-3b5f-4655-967c-e961c02e6b40', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:56.014925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da3ba78-4160-4899-b295-108d047e093c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:56.017103 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da3ba78-4160-4899-b295-108d047e093c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:56.019212 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbd6eaa-e00b-49b0-9387-8738f0f34ad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:56.020038 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Volume 0c6d677d-3b5f-4655-967c-e961c02e6b40: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0c6d677d-3b5f-4655-967c-e961c02e6b40', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 20:58:56.020634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Cloning 0c6d677d-3b5f-4655-967c-e961c02e6b40 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 20:58:56.033316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:58:56.046323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 20, 58, 56, 40676)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 20:58:56.048099 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 20:58:56.048567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 20:58:56.053091 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:58:56.054133 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 20:58:56.070438 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 20, 58, 56, 57510)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 20:58:56.070852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 20:58:56.071238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 20:58:56.084229 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:56.144774 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] creating snapshot='volume-0c6d677d-3b5f-4655-967c-e961c02e6b40.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 20:58:57.167205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-0c6d677d-3b5f-4655-967c-e961c02e6b40.clone_snap' to 'volume-0c6d677d-3b5f-4655-967c-e961c02e6b40' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 20:58:57.323924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:58:57.329069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:57.329444 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:57.350739 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 20:58:57.351712 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Marking volume 0c6d677d-3b5f-4655-967c-e961c02e6b40 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 20:58:57.361764 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 0c6d677d-3b5f-4655-967c-e961c02e6b40. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 20:58:57.362250 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Creating volume glance metadata for volume 0c6d677d-3b5f-4655-967c-e961c02e6b40 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 20:58:57.470763 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2bbd6eaa-e00b-49b0-9387-8738f0f34ad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c6d677d-3b5f-4655-967c-e961c02e6b40', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:57.474442 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457327e-be6c-4f5a-b3a4-1b95b8812e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:57.487114 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Volume volume-0c6d677d-3b5f-4655-967c-e961c02e6b40 (0c6d677d-3b5f-4655-967c-e961c02e6b40): created successfully Nov 06 20:58:57.490022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0457327e-be6c-4f5a-b3a4-1b95b8812e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:57.494105 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Flow 'volume_create_manager' (f42fd54a-d8bf-4daf-8285-87fe3d8ae02d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:57.510831 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6bc6eacd-1113-4dae-9894-49e925de972e tempest-VolumesExtendTest-35802647 None] Created volume successfully. Nov 06 20:58:58.093159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5d2cd247-cc47-432d-8805-0b74ce04ec8a tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:58.254849 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5d2cd247-cc47-432d-8805-0b74ce04ec8a tempest-VolumesExtendTest-35802647 None] Extend volume from 1 GB to 2 GB. {{(pid=127482) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1729}} Nov 06 20:58:58.286067 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5d2cd247-cc47-432d-8805-0b74ce04ec8a tempest-VolumesExtendTest-35802647 None] Extend volume completed successfully. Nov 06 20:58:59.651205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:58:59.655344 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:58:59.655999 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:58:59.668809 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Flow 'volume_create_manager' (43e82e4e-ecab-4d61-b009-5209944bbf39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:59.672672 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355ccfa5-c738-447f-b516-9f4c3cec5c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.679167 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:58:59.692053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355ccfa5-c738-447f-b516-9f4c3cec5c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1053703504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82e9bba0db4c457594a2f4b31a7dc9b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:00Z,use_quota=True,user_id='cce6d29faec5406cb9b3566d827e3cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.694832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f593d18a-2552-41e3-b4a2-5ec701d70900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.697069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f593d18a-2552-41e3-b4a2-5ec701d70900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.699369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08163c26-0562-4874-bdb7-e366beb4f1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.701627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08163c26-0562-4874-bdb7-e366beb4f1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7', 'volume_name': 'volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.703840 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f3c12d-690f-4206-a2d2-3743f10758c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.705884 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f3c12d-690f-4206-a2d2-3743f10758c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.708045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08910a4b-f4d6-4693-8ac6-614fc83cfd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.708841 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Volume ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7', 'volume_size': 1} Nov 06 20:58:59.709235 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] creating volume 'volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:58:59.710205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:58:59.820028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:58:59.820435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:58:59.822373 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08910a4b-f4d6-4693-8ac6-614fc83cfd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.824468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bbcd4a-4338-4090-8eef-c12dd165edeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:58:59.842678 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Volume volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7 (ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7): created successfully Nov 06 20:58:59.845491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7bbcd4a-4338-4090-8eef-c12dd165edeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:58:59.849153 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Flow 'volume_create_manager' (43e82e4e-ecab-4d61-b009-5209944bbf39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:58:59.860141 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c3c14f62-4715-4008-8678-f52c8270d1ed tempest-VolumesExtendTest-35802647 None] Created volume successfully. Nov 06 20:59:00.937057 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-31ca80dd-7062-44e8-8703-58bc7e1d233c tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:01.577663 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-31ca80dd-7062-44e8-8703-58bc7e1d233c tempest-VolumesExtendTest-35802647 None] Create snapshot completed successfully Nov 06 20:59:02.147901 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c0937e12-e330-4272-9a9f-5f55b86dfcf0 tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:02.236768 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c0937e12-e330-4272-9a9f-5f55b86dfcf0 tempest-VolumesExtendTest-35802647 None] Extend volume from 1 GB to 2 GB. {{(pid=127482) extend_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1729}} Nov 06 20:59:02.263168 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c0937e12-e330-4272-9a9f-5f55b86dfcf0 tempest-VolumesExtendTest-35802647 None] Extend volume completed successfully. Nov 06 20:59:03.397855 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-3b7b1a4e-3cb5-450d-b681-08bd5218c239 tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-cfcb8e6f-fd0e-4e47-91f5-f1a0dbe6c5e7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:03.409665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3b7b1a4e-3cb5-450d-b681-08bd5218c239 tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:04.692966 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-3b7b1a4e-3cb5-450d-b681-08bd5218c239 tempest-VolumesExtendTest-35802647 None] Created reservations ['2017ec4c-fc76-4c2a-a313-d9cec7fb28d5', '7ec4337d-e50b-4f66-8e40-1d308c53175c', '5e312b83-9769-4b1d-8d92-138b4234daef', '84aa0b9a-802c-40f5-bf89-0d0d47e47e38'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:04.731719 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-3b7b1a4e-3cb5-450d-b681-08bd5218c239 tempest-VolumesExtendTest-35802647 None] Delete snapshot completed successfully. Nov 06 20:59:04.737564 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-3b7b1a4e-3cb5-450d-b681-08bd5218c239 tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-cfcb8e6f-fd0e-4e47-91f5-f1a0dbe6c5e7-delete_snapshot'" released by "delete_snapshot" :: held 1.340s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:05.605159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7-delete_volume'" acquired by "delete_volume" :: waited 0.028s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:05.698791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:05.790925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:05.791585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Volume volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:59:05.809431 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] deleting rbd volume volume-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:06.207191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Created reservations ['e1f9b61d-588d-4b0f-9957-320a31d491e0', '44933b17-1f83-495b-9263-70bd1f07744a', '9023a196-011a-4477-9a36-f565f9c78c0b', 'ec31b8d7-dfc3-4072-8ebb-d6783bd50a1c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:06.319176 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:06.365346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:06.445756 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:06.452503 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Deleted volume successfully. Nov 06 20:59:06.493029 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-962e756e-e676-4c13-b02a-b01cf9710db8 tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-ee9b53b2-e7a1-4ed9-bb67-5ab0ee6f1fa7-delete_volume'" released by "delete_volume" :: held 0.888s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:06.790284 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-0c6d677d-3b5f-4655-967c-e961c02e6b40-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:06.842143 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:06.941152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:06.957832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] deleting rbd volume volume-0c6d677d-3b5f-4655-967c-e961c02e6b40 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:07.190100 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 20:59:07.220187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] deleting parent snapshot volume-0c6d677d-3b5f-4655-967c-e961c02e6b40.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 20:59:08.316132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] Created reservations ['967fce11-61fa-4a35-9e91-65b406cb5e06', 'f4c43e30-541a-4367-8d76-a6f9e56909ca', 'a08c320b-674e-4a18-80e4-5c3099a5d908', '5cfc44bf-7061-4c3d-8b8a-81f4dc491532'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:08.378645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:08.434342 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:08.481276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:08.485401 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] Deleted volume successfully. Nov 06 20:59:08.499847 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-972070cb-a3f9-4b6f-9322-9b023638c1cf tempest-VolumesExtendTest-35802647 None] Lock "b'cinder-0c6d677d-3b5f-4655-967c-e961c02e6b40-delete_volume'" released by "delete_volume" :: held 1.710s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:10.082297 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 20:59:10.084702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:10.144414 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:10.219080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:14.501997 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:59:14.505381 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:59:14.505820 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:59:14.521035 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (aa1a2638-a17d-4c59-a723-ad6c37e8e590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:14.524089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9fb36d-7f7e-40a0-9fc6-9672b6bbbe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.534998 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:59:14.548673 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9fb36d-7f7e-40a0-9fc6-9672b6bbbe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1401990729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92f768b8-b340-4f7a-8c00-0638670512b8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6d4a63029304e1ab4e8d02ff84ed95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:14Z,use_quota=True,user_id='3e7fd19b957144598d567e058244b7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.551623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c6ce01-608f-4686-b23f-0da540bcb6f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.554583 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55c6ce01-608f-4686-b23f-0da540bcb6f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.556868 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be442d22-6694-4e28-93fc-2d65a3daf6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.558993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be442d22-6694-4e28-93fc-2d65a3daf6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92f768b8-b340-4f7a-8c00-0638670512b8', 'volume_name': 'volume-92f768b8-b340-4f7a-8c00-0638670512b8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.561376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b09f2b-d907-4059-82c6-06c725e30716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.563395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b09f2b-d907-4059-82c6-06c725e30716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.565993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22287b11-cad6-4462-aeaa-e808b6d7486e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.566743 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Volume 92f768b8-b340-4f7a-8c00-0638670512b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92f768b8-b340-4f7a-8c00-0638670512b8', 'volume_size': 1} Nov 06 20:59:14.567125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] creating volume 'volume-92f768b8-b340-4f7a-8c00-0638670512b8' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:59:14.568091 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:14.643581 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:59:14.644059 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:59:14.646106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22287b11-cad6-4462-aeaa-e808b6d7486e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92f768b8-b340-4f7a-8c00-0638670512b8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.648230 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916b6048-b737-4fb1-b08b-c9e2d6d15920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:14.661390 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Volume volume-92f768b8-b340-4f7a-8c00-0638670512b8 (92f768b8-b340-4f7a-8c00-0638670512b8): created successfully Nov 06 20:59:14.663971 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916b6048-b737-4fb1-b08b-c9e2d6d15920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:14.669085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (aa1a2638-a17d-4c59-a723-ad6c37e8e590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:14.678345 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5212cef1-7ab1-4121-8bb6-bfbc4f919a50 tempest-VolumesListTestJSON-1374453801 None] Created volume successfully. Nov 06 20:59:16.105690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:59:16.113484 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:59:16.114412 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:59:16.142811 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (89f21870-3d32-42f8-8d8b-fb2e7cd968aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:16.147116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695eb1dc-963c-4b79-a8b8-9d5cdf913006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.162890 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:59:16.178187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (695eb1dc-963c-4b79-a8b8-9d5cdf913006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:59:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1352084436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cea8d068-9050-41e6-8307-7d7139d08f80,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6d4a63029304e1ab4e8d02ff84ed95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:16Z,use_quota=True,user_id='3e7fd19b957144598d567e058244b7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.182418 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ce98e-9a11-408c-b966-1e94229c92ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.185841 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8ce98e-9a11-408c-b966-1e94229c92ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.188839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5e2f62-676c-40a6-a881-c8c2a2c643b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.192545 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a5e2f62-676c-40a6-a881-c8c2a2c643b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cea8d068-9050-41e6-8307-7d7139d08f80', 'volume_name': 'volume-cea8d068-9050-41e6-8307-7d7139d08f80', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.197403 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784c5ee2-4e21-4de4-a215-9fd467733b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.200032 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (784c5ee2-4e21-4de4-a215-9fd467733b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.203306 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbc5826-bbf4-4d90-9405-4edaa51d009f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.204282 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Volume cea8d068-9050-41e6-8307-7d7139d08f80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cea8d068-9050-41e6-8307-7d7139d08f80', 'volume_size': 1} Nov 06 20:59:16.204870 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] creating volume 'volume-cea8d068-9050-41e6-8307-7d7139d08f80' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:59:16.206491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:16.307249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:59:16.307753 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:59:16.309932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dbc5826-bbf4-4d90-9405-4edaa51d009f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cea8d068-9050-41e6-8307-7d7139d08f80', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.313534 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ad5176-c540-464f-87ce-841c2cc5cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:16.322076 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Volume volume-cea8d068-9050-41e6-8307-7d7139d08f80 (cea8d068-9050-41e6-8307-7d7139d08f80): created successfully Nov 06 20:59:16.329468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ad5176-c540-464f-87ce-841c2cc5cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:16.333467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (89f21870-3d32-42f8-8d8b-fb2e7cd968aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:16.344614 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a829d040-b1d1-4d7b-aa2c-6bc9ed20ad86 tempest-VolumesListTestJSON-1374453801 None] Created volume successfully. Nov 06 20:59:17.752424 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:59:17.758924 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:59:17.759594 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:59:17.804479 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (28d9bda3-2feb-429b-97e9-592085fd8582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:17.811991 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d1e131-93d1-4134-bfd5-78e1ed87cb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:17.833001 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:59:17.865805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5d1e131-93d1-4134-bfd5-78e1ed87cb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1144803025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=aff7f877-7008-4357-84a2-8c4b362d4868,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e6d4a63029304e1ab4e8d02ff84ed95f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:18Z,use_quota=True,user_id='3e7fd19b957144598d567e058244b7e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:17.875604 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8717c6-a45b-482c-a9be-151602a58052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:17.884519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf8717c6-a45b-482c-a9be-151602a58052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:17.891152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbb492e-b750-4f7f-bd27-e78c3887b1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:17.894296 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dbb492e-b750-4f7f-bd27-e78c3887b1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff7f877-7008-4357-84a2-8c4b362d4868', 'volume_name': 'volume-aff7f877-7008-4357-84a2-8c4b362d4868', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:17.897083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee96f1b-5048-46e0-b914-99737937fbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:17.899900 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee96f1b-5048-46e0-b914-99737937fbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:17.902323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306526d-d251-4b88-b2bb-1bd7c3f4aa1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:17.903323 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Volume aff7f877-7008-4357-84a2-8c4b362d4868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff7f877-7008-4357-84a2-8c4b362d4868', 'volume_size': 1} Nov 06 20:59:17.904009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] creating volume 'volume-aff7f877-7008-4357-84a2-8c4b362d4868' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:59:17.905198 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:18.081982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:59:18.082537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:59:18.084893 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7306526d-d251-4b88-b2bb-1bd7c3f4aa1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff7f877-7008-4357-84a2-8c4b362d4868', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:18.089328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500a9a02-af66-44f5-9edb-a20d1a5bd6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:18.109441 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Volume volume-aff7f877-7008-4357-84a2-8c4b362d4868 (aff7f877-7008-4357-84a2-8c4b362d4868): created successfully Nov 06 20:59:18.112139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (500a9a02-af66-44f5-9edb-a20d1a5bd6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:18.121372 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Flow 'volume_create_manager' (28d9bda3-2feb-429b-97e9-592085fd8582) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:18.144824 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-39cb9d90-0cb4-43fe-954a-c96c96865062 tempest-VolumesListTestJSON-1374453801 None] Created volume successfully. Nov 06 20:59:22.748855 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-aff7f877-7008-4357-84a2-8c4b362d4868-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:22.803163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:22.877208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:22.877861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Volume volume-aff7f877-7008-4357-84a2-8c4b362d4868 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:59:22.895634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] deleting rbd volume volume-aff7f877-7008-4357-84a2-8c4b362d4868 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:23.376451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Created reservations ['66b1ce5d-3f18-4181-999e-cf305321dee2', 'eec44fb7-e538-47c3-97cd-2ddee7ab912c', '031c4db7-0bd1-4359-9361-433815457568', 'b7a92b6d-2d01-4e2c-bbe1-d7f63c172714'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:23.445746 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:23.526497 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:23.578948 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:23.591652 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Deleted volume successfully. Nov 06 20:59:23.618100 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-74969507-06d2-463f-96c4-fe53a08afa70 tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-aff7f877-7008-4357-84a2-8c4b362d4868-delete_volume'" released by "delete_volume" :: held 0.869s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:24.031233 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-cea8d068-9050-41e6-8307-7d7139d08f80-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:24.143525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:24.239982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:24.240400 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Volume volume-cea8d068-9050-41e6-8307-7d7139d08f80 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:59:24.254926 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] deleting rbd volume volume-cea8d068-9050-41e6-8307-7d7139d08f80 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:24.808065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Created reservations ['2f5932e4-a201-4877-8ec8-69b315e637d9', '6da6824f-ee9a-48fc-aaac-6af064a7ce32', '2e379a3f-0fa0-4065-9ecd-7b831365e8e3', '0e63ed46-a792-4aa8-8b6d-91d8cbb857aa'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:24.914550 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:24.999420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:25.058210 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:25.063907 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Deleted volume successfully. Nov 06 20:59:25.082471 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-abc31f69-9036-465d-9489-dfb7781e5d0a tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-cea8d068-9050-41e6-8307-7d7139d08f80-delete_volume'" released by "delete_volume" :: held 1.052s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:25.316454 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-92f768b8-b340-4f7a-8c00-0638670512b8-delete_volume'" acquired by "delete_volume" :: waited 0.019s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:25.442556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:25.527782 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:25.528370 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Volume volume-92f768b8-b340-4f7a-8c00-0638670512b8 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:59:25.541199 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] deleting rbd volume volume-92f768b8-b340-4f7a-8c00-0638670512b8 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:26.033446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Created reservations ['ed9c58b8-567b-4e6a-af2a-b792d7b9b365', '560acc09-1cf5-4da6-9701-2f17dbe26638', '8f35e51c-40ea-4d25-96d1-028e544b7a5c', 'c8791ded-3a63-44ff-8e2a-38df0d8d808f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:26.156011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:26.250417 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:26.336093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:26.349597 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Deleted volume successfully. Nov 06 20:59:26.370621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7a6e5e86-bca8-4683-9d9c-42512f1c85a9 tempest-VolumesListTestJSON-1374453801 None] Lock "b'cinder-92f768b8-b340-4f7a-8c00-0638670512b8-delete_volume'" released by "delete_volume" :: held 1.054s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:29.621032 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:59:29.624564 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:59:29.624999 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:59:29.636713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Flow 'volume_create_manager' (073500cd-b6fa-4639-affd-69db327f35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:29.639850 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33bd27e-fbc4-48d0-a409-21eb3597e1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.646350 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:59:29.659025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a33bd27e-fbc4-48d0-a409-21eb3597e1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-479073737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1169b647-c4fb-4679-bc18-2a9c28a0dfe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='917b0d24d6834326a922c2873edae7ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:30Z,use_quota=True,user_id='ee7f5200122b45c7b275b11d9ea4b645',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.661475 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05af9b4-4ed5-4729-81e4-9322232c3db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.663497 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05af9b4-4ed5-4729-81e4-9322232c3db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.665787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55cab8a-7cee-40da-914a-87648a7c9507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.668163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a55cab8a-7cee-40da-914a-87648a7c9507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1169b647-c4fb-4679-bc18-2a9c28a0dfe8', 'volume_name': 'volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.671094 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0ba7a7-4f96-42a9-8f41-9feb9225d431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.673129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0ba7a7-4f96-42a9-8f41-9feb9225d431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.675204 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ea7ca5-c4b0-417f-ab3c-9827dbc154ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.675942 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Volume 1169b647-c4fb-4679-bc18-2a9c28a0dfe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8', 'volume_size': 1} Nov 06 20:59:29.676356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] creating volume 'volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:59:29.677322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:29.737280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:59:29.737653 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:59:29.739604 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ea7ca5-c4b0-417f-ab3c-9827dbc154ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.741703 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa311931-6b42-41c6-bbb6-a7b0def375c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:29.749972 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Volume volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8 (1169b647-c4fb-4679-bc18-2a9c28a0dfe8): created successfully Nov 06 20:59:29.752030 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa311931-6b42-41c6-bbb6-a7b0def375c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:29.755116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Flow 'volume_create_manager' (073500cd-b6fa-4639-affd-69db327f35ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:29.773379 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-efbbb729-724b-41bf-9945-10d4717e5ef4 tempest-VolumesSnapshotListTestJSON-292375434 None] Created volume successfully. Nov 06 20:59:31.014085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-030cdcef-21c4-4bef-8bd0-1b6bc3f16130 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:31.571948 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-030cdcef-21c4-4bef-8bd0-1b6bc3f16130 tempest-VolumesSnapshotListTestJSON-292375434 None] Create snapshot completed successfully Nov 06 20:59:32.281097 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-49cf1308-2639-4a3c-8343-1bbb5fec88ab tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:32.645012 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-49cf1308-2639-4a3c-8343-1bbb5fec88ab tempest-VolumesSnapshotListTestJSON-292375434 None] Create snapshot completed successfully Nov 06 20:59:33.471132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0b2aec28-4084-455b-ad39-19de44377ab5 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:34.641829 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0b2aec28-4084-455b-ad39-19de44377ab5 tempest-VolumesSnapshotListTestJSON-292375434 None] Create snapshot completed successfully Nov 06 20:59:36.363556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-f041e701-03ab-4b66-b0c5-d0dfff51dcaf tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-19691acc-c5c0-49e8-b5e9-5e04b2493f8f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:36.365913 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f041e701-03ab-4b66-b0c5-d0dfff51dcaf tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:37.288680 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-f041e701-03ab-4b66-b0c5-d0dfff51dcaf tempest-VolumesSnapshotListTestJSON-292375434 None] Created reservations ['a6148a9f-48c0-47e8-8c79-d040d017b3a7', '7c875b4d-1e6a-4b17-bf7d-8edacbbc3c2f', '142cd9b5-1e58-47c9-9f1e-f7fb59b20592', '2aae500d-4d07-4c74-8cf8-d2ba474e458e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:37.342855 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-f041e701-03ab-4b66-b0c5-d0dfff51dcaf tempest-VolumesSnapshotListTestJSON-292375434 None] Delete snapshot completed successfully. Nov 06 20:59:37.349471 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-f041e701-03ab-4b66-b0c5-d0dfff51dcaf tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-19691acc-c5c0-49e8-b5e9-5e04b2493f8f-delete_snapshot'" released by "delete_snapshot" :: held 0.986s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:37.468428 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0247b22f-e7e0-4af6-9127-93332c354974 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-8e4564e3-8921-4ff1-8ddf-7bc1a72498c0-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:37.470259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0247b22f-e7e0-4af6-9127-93332c354974 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:38.424167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0247b22f-e7e0-4af6-9127-93332c354974 tempest-VolumesSnapshotListTestJSON-292375434 None] Created reservations ['83351fa9-8a96-43ee-a5be-831593ce894e', '5f807e9f-36e7-4295-ae56-f80eff103d87', 'a3b60268-6908-47c8-b025-d1526e663071', '597701e2-11cd-49c4-b72e-173d1571278f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:38.521577 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0247b22f-e7e0-4af6-9127-93332c354974 tempest-VolumesSnapshotListTestJSON-292375434 None] Delete snapshot completed successfully. Nov 06 20:59:38.529749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0247b22f-e7e0-4af6-9127-93332c354974 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-8e4564e3-8921-4ff1-8ddf-7bc1a72498c0-delete_snapshot'" released by "delete_snapshot" :: held 1.062s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:38.608154 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-45d4c2ba-eef5-4e6a-a80d-8450f41620f7 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-d299153d-3ebe-4d04-b3a4-fecac03f6afa-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:38.610982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-45d4c2ba-eef5-4e6a-a80d-8450f41620f7 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:39.313483 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-45d4c2ba-eef5-4e6a-a80d-8450f41620f7 tempest-VolumesSnapshotListTestJSON-292375434 None] Created reservations ['dfea9dbc-6837-42ec-90d6-e1b74e0dbb7b', '529483ce-0f81-4f7f-95c4-c6b92bd187e9', '988bcc2a-b2b0-42df-a35d-8dbdb1c3c26d', 'af2e18bc-f734-4829-8261-fd541ca59e25'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:39.355140 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-45d4c2ba-eef5-4e6a-a80d-8450f41620f7 tempest-VolumesSnapshotListTestJSON-292375434 None] Delete snapshot completed successfully. Nov 06 20:59:39.361665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-45d4c2ba-eef5-4e6a-a80d-8450f41620f7 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-d299153d-3ebe-4d04-b3a4-fecac03f6afa-delete_snapshot'" released by "delete_snapshot" :: held 0.753s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:39.741927 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-1169b647-c4fb-4679-bc18-2a9c28a0dfe8-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 20:59:39.783500 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:39.852589 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 20:59:39.854319 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Volume volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 20:59:39.871365 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] deleting rbd volume volume-1169b647-c4fb-4679-bc18-2a9c28a0dfe8 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 20:59:40.199129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Created reservations ['6146fdd2-efdf-4600-8030-eec70e3071d3', '40702c6b-5e11-45a6-a63a-913b3726bc8f', 'fae254a6-190b-40f4-97c0-3ef7eb053084', '4878c608-c6a0-4546-a503-54ef33725032'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 20:59:40.260611 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:40.309022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:40.351625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 20:59:40.355840 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Deleted volume successfully. Nov 06 20:59:40.373897 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-058f2a22-4f6f-493f-97a5-68ed6c20afe8 tempest-VolumesSnapshotListTestJSON-292375434 None] Lock "b'cinder-1169b647-c4fb-4679-bc18-2a9c28a0dfe8-delete_volume'" released by "delete_volume" :: held 0.630s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 20:59:56.009710 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-c4718eda-22fc-48dd-846c-2f4b1b27c345 tempest-TaggedBootDevicesTest_v242-541674125 None] Terminate volume connection completed successfully. Nov 06 20:59:56.010317 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-c4718eda-22fc-48dd-846c-2f4b1b27c345 tempest-TaggedBootDevicesTest_v242-541674125 None] Deleting attachment beb1fd4e-0454-41ba-b84c-996bd092553a. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:59:56.118948 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-19d2a29d-0571-4c3a-8c86-5b9c765ef185 tempest-TaggedBootDevicesTest_v242-541674125 None] Terminate volume connection completed successfully. Nov 06 20:59:56.119454 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-19d2a29d-0571-4c3a-8c86-5b9c765ef185 tempest-TaggedBootDevicesTest_v242-541674125 None] Deleting attachment 42cab9f1-ec03-47b5-8166-c0b38fb90036. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:59:56.226659 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-3fc23bdd-50ba-4335-8201-ae6afa785b8d tempest-TaggedBootDevicesTest_v242-541674125 None] Terminate volume connection completed successfully. Nov 06 20:59:56.227390 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a642db04-c978-44a8-b6fd-9fc7aebf7fbe req-3fc23bdd-50ba-4335-8201-ae6afa785b8d tempest-TaggedBootDevicesTest_v242-541674125 None] Deleting attachment 68b6b3cc-dc4f-4a02-b58b-6e64ee1d7d33. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 20:59:57.538660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 20:59:57.542494 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 20:59:57.542957 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 20:59:57.555226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Flow 'volume_create_manager' (c1d9d809-3d7d-41a5-9aae-8882c36c322c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:57.558331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607b362a-526e-4d53-b81b-7bda005fb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.565013 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 20:59:57.577120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (607b362a-526e-4d53-b81b-7bda005fb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T20:59:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-LiveMigrationTest-volume-1647107791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=52646cb2-a717-4fe2-97f2-d75adef114f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80ec8702cd94e0eaefdf3eb907a0cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T20:59:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T20:59:58Z,use_quota=True,user_id='0cbe3496db994852a09c97ee075fbd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.579621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889f21b-ac5d-40dd-97f9-57443f35e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.581698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2889f21b-ac5d-40dd-97f9-57443f35e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.584617 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04b58a-fb68-4135-8fc1-3c9389797a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.586755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f04b58a-fb68-4135-8fc1-3c9389797a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52646cb2-a717-4fe2-97f2-d75adef114f7', 'volume_name': 'volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.588998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d0c4c6-2431-4d0c-afef-34060ead0781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.591037 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d0c4c6-2431-4d0c-afef-34060ead0781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.593155 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fda3d1-9c9f-4d28-9964-30e291ac5202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.593901 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Volume 52646cb2-a717-4fe2-97f2-d75adef114f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'volume_size': 1} Nov 06 20:59:57.594292 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] creating volume 'volume-52646cb2-a717-4fe2-97f2-d75adef114f7' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 20:59:57.595250 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 20:59:57.652950 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 20:59:57.653329 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 20:59:57.655356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7fda3d1-9c9f-4d28-9964-30e291ac5202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.657534 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93573685-50ca-48f1-8f5f-6ab781b3b22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 20:59:57.667297 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Volume volume-52646cb2-a717-4fe2-97f2-d75adef114f7 (52646cb2-a717-4fe2-97f2-d75adef114f7): created successfully Nov 06 20:59:57.670566 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93573685-50ca-48f1-8f5f-6ab781b3b22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 20:59:57.673494 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Flow 'volume_create_manager' (c1d9d809-3d7d-41a5-9aae-8882c36c322c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 20:59:57.682726 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0ab4b058-10db-49ff-becf-dc1c94ceae40 tempest-LiveMigrationTest-2007295791 None] Created volume successfully. Nov 06 20:59:59.023981 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-7cf0095a-e369-4115-9e2b-bf249c0675f1 req-7cdf67ca-7fe9-4337-96fc-50fe5184167f tempest-LiveMigrationTest-2007295791 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 20:59:59.698397 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-7cf0095a-e369-4115-9e2b-bf249c0675f1 req-7cdf67ca-7fe9-4337-96fc-50fe5184167f tempest-LiveMigrationTest-2007295791 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.674s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 20:59:59.699351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-7cf0095a-e369-4115-9e2b-bf249c0675f1 req-7cdf67ca-7fe9-4337-96fc-50fe5184167f tempest-LiveMigrationTest-2007295791 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '52646cb2-a717-4fe2-97f2-d75adef114f7', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 20:59:59.724664 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-7cf0095a-e369-4115-9e2b-bf249c0675f1 req-7cdf67ca-7fe9-4337-96fc-50fe5184167f tempest-LiveMigrationTest-2007295791 None] Connection info returned from driver {'name': 'volumes/volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '52646cb2-a717-4fe2-97f2-d75adef114f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ade117f3-c5b6-4b71-825f-5f0e330d9d62'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 20:59:59.772316 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-7cf0095a-e369-4115-9e2b-bf249c0675f1 req-7cdf67ca-7fe9-4337-96fc-50fe5184167f tempest-LiveMigrationTest-2007295791 None] attachment_update completed successfully. Nov 06 21:00:02.042787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:00:02.109075 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:02.199511 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:00:02.200337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:00:02.207771 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] deleting rbd volume volume-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:00:02.429759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Created reservations ['0eb034ca-5658-4967-b1d1-a211180f8c9f', 'f3b19400-0497-417d-ba00-1450059bec03', '0aa771e5-26ad-425e-882b-650e1fa15de9', 'dc915126-7dee-4aa1-89b2-3e5b08f2cff6'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:00:02.469115 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:02.506194 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:02.572663 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:00:02.577025 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Deleted volume successfully. Nov 06 21:00:02.593850 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1ea65988-e805-4e2e-b9c6-20703ba8f965 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-9ea41b61-af05-480d-8dfc-e3a3b9ca2d4b-delete_volume'" released by "delete_volume" :: held 0.551s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:00:03.252575 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-c0d911bb-c272-4d66-8272-d951168b4a48-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:00:03.297689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:03.367241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:00:03.367749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-c0d911bb-c272-4d66-8272-d951168b4a48 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:00:03.374429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] deleting rbd volume volume-c0d911bb-c272-4d66-8272-d951168b4a48 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:00:03.629845 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Created reservations ['c4ce61a6-ecef-4ac0-9e1e-cfd378cd2ae4', '1d374e5f-7053-4876-93a1-5b5eba92da12', '74a5189f-2f5b-48f9-b9ec-a3c12680f3d7', '79b65c1c-110a-4ac7-8060-45833bbac72b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:00:03.684320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:03.737513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:03.771884 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:00:03.777611 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Deleted volume successfully. Nov 06 21:00:03.790654 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-63231da4-874f-4c39-9510-f5a4c995bd19 tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-c0d911bb-c272-4d66-8272-d951168b4a48-delete_volume'" released by "delete_volume" :: held 0.538s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:00:04.417864 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-7f35eb51-5bb5-43ec-a170-cc81ed19014d-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:00:04.453083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:04.511290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:00:04.512982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] volume has clone snapshot(s) {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1205}} Nov 06 21:00:04.515166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:00:04.623171 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Created reservations ['5f46ff43-cffb-4502-8bc3-3d0b69c137cd', '12d594b7-3377-4858-a79d-5ec676a3d812', 'ad0a018f-79d3-47df-bd3b-bf5e8924cd30', 'd58370f8-e2b1-4735-bf0c-f51ca388868f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:00:04.665890 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:04.695494 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:04.723445 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:00:04.728256 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Deleted volume successfully. Nov 06 21:00:04.741907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a72ba6bb-76ac-4ebd-b370-ec58930dddbb tempest-TaggedBootDevicesTest_v242-541674125 None] Lock "b'cinder-7f35eb51-5bb5-43ec-a170-cc81ed19014d-delete_volume'" released by "delete_volume" :: held 0.324s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:00:05.023303 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-f6f84eaa-343c-4ad8-bbc6-696ef2a2ad15 tempest-LiveMigrationTest-2087109617 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:00:05.699399 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-f6f84eaa-343c-4ad8-bbc6-696ef2a2ad15 tempest-LiveMigrationTest-2087109617 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:00:05.700284 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-f6f84eaa-343c-4ad8-bbc6-696ef2a2ad15 tempest-LiveMigrationTest-2087109617 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '52646cb2-a717-4fe2-97f2-d75adef114f7', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:00:05.724597 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-f6f84eaa-343c-4ad8-bbc6-696ef2a2ad15 tempest-LiveMigrationTest-2087109617 None] Connection info returned from driver {'name': 'volumes/volume-52646cb2-a717-4fe2-97f2-d75adef114f7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '52646cb2-a717-4fe2-97f2-d75adef114f7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3cf3c8e1-249b-48b9-b91f-12a1fdde463e'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:00:05.776137 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-f6f84eaa-343c-4ad8-bbc6-696ef2a2ad15 tempest-LiveMigrationTest-2087109617 None] attachment_update completed successfully. Nov 06 21:00:10.084038 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:00:10.085648 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:10.126525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:10.165148 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:00:15.596959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:00:15.607956 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:00:15.608725 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:00:15.647303 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Flow 'volume_create_manager' (6ffef7f5-d3f8-40d6-98ad-1042d4901655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:00:15.650743 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05c02d0-251f-4ddf-9a53-da55dda54371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.658047 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:00:15.672705 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f05c02d0-251f-4ddf-9a53-da55dda54371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1026038616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92099a35-b4f5-4cb9-9285-2333c72f94df,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a8c9af4873fb47b69861f9551567385c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:00:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:00:16Z,use_quota=True,user_id='3477b084f2a64d34bbf140869e076d07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.675548 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f5f621-bb98-4c74-aa0d-5816f09a1050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.677863 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1f5f621-bb98-4c74-aa0d-5816f09a1050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.680380 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c10a5-5c17-474b-8a52-f95524f8c61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.682793 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (121c10a5-5c17-474b-8a52-f95524f8c61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92099a35-b4f5-4cb9-9285-2333c72f94df', 'volume_name': 'volume-92099a35-b4f5-4cb9-9285-2333c72f94df', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.685223 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6c0749-ecc0-4a41-a609-a374207560fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.687357 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca6c0749-ecc0-4a41-a609-a374207560fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.689630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab42737e-4824-417d-93fd-036795d14786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.690819 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Volume 92099a35-b4f5-4cb9-9285-2333c72f94df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92099a35-b4f5-4cb9-9285-2333c72f94df', 'volume_size': 1} Nov 06 21:00:15.691291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] creating volume 'volume-92099a35-b4f5-4cb9-9285-2333c72f94df' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:00:15.692320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:15.801344 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-fc5a6505-c22f-42d9-81e7-96df4d5d8905 tempest-LiveMigrationTest-2087109617 None] Terminate volume connection completed successfully. Nov 06 21:00:15.801690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-212821f3-ed79-46ba-9c1a-58b71f8a4ab4 req-fc5a6505-c22f-42d9-81e7-96df4d5d8905 tempest-LiveMigrationTest-2087109617 None] Deleting attachment ade117f3-c5b6-4b71-825f-5f0e330d9d62. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:00:15.825337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:00:15.825989 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:00:15.828865 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab42737e-4824-417d-93fd-036795d14786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92099a35-b4f5-4cb9-9285-2333c72f94df', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.832727 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b2a03-cfa0-44a0-8c88-7490482ac90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:15.887058 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Volume volume-92099a35-b4f5-4cb9-9285-2333c72f94df (92099a35-b4f5-4cb9-9285-2333c72f94df): created successfully Nov 06 21:00:15.889364 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd1b2a03-cfa0-44a0-8c88-7490482ac90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:15.892714 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Flow 'volume_create_manager' (6ffef7f5-d3f8-40d6-98ad-1042d4901655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:00:15.904592 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-faa8fe9a-b5b3-4e98-8902-f1def9c036d6 req-c26d48d2-4a91-47d7-b06c-d1ce3094f77f tempest-VolumesGetTestJSON-235430414 None] Created volume successfully. Nov 06 21:00:17.125204 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Lock "b'cinder-92099a35-b4f5-4cb9-9285-2333c72f94df-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:00:17.163963 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:17.244079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:00:17.244832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Volume volume-92099a35-b4f5-4cb9-9285-2333c72f94df is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:00:17.251647 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] deleting rbd volume volume-92099a35-b4f5-4cb9-9285-2333c72f94df {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:00:17.514253 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Created reservations ['d731480d-35c0-4556-b387-da97b34d60d4', '8f9bf560-ffdb-4f3a-b553-722444a47549', 'b523d92e-bba3-4687-8714-b5c0e873468d', 'ffad41e2-facd-4151-825e-ac4e7615e7cc'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:00:17.594487 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:17.657836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:17.700192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:00:17.705242 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Deleted volume successfully. Nov 06 21:00:17.721019 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-ba3c727c-03df-49ef-9824-940b57867bf8 req-92befa0e-e4e2-480e-bf13-f86670058b7e tempest-VolumesGetTestJSON-235430414 None] Lock "b'cinder-92099a35-b4f5-4cb9-9285-2333c72f94df-delete_volume'" released by "delete_volume" :: held 0.596s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:00:22.682089 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-5175a029-bfdb-4bac-9232-e2a0de08d7bc req-db416a54-1df9-4841-a875-ced2dee69382 tempest-LiveMigrationTest-2007295791 None] Terminate volume connection completed successfully. Nov 06 21:00:22.682761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-5175a029-bfdb-4bac-9232-e2a0de08d7bc req-db416a54-1df9-4841-a875-ced2dee69382 tempest-LiveMigrationTest-2007295791 None] Deleting attachment 3cf3c8e1-249b-48b9-b91f-12a1fdde463e. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:00:23.705899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:00:23.712241 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:00:23.713673 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:00:23.749009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Flow 'volume_create_manager' (cea9f0b8-1582-4e1b-a09f-f5eb1bea4358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:00:23.752544 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59fa65-69bb-4a66-8e07-2a0035adf5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:23.759058 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:00:23.772990 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c59fa65-69bb-4a66-8e07-2a0035adf5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:00:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1966580777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=01801acc-999e-4e59-ba88-ced3b1ed63c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a80ec8702cd94e0eaefdf3eb907a0cff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:00:24Z,use_quota=True,user_id='0cbe3496db994852a09c97ee075fbd4a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:23.785208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5db7c2-8a27-4372-9ced-1babd32e836f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:23.787739 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f5db7c2-8a27-4372-9ced-1babd32e836f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:23.790354 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c967f60b-48a0-421e-a127-bdee406aac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:23.949849 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c967f60b-48a0-421e-a127-bdee406aac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '01801acc-999e-4e59-ba88-ced3b1ed63c5', 'volume_name': 'volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:23.952781 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67a8fed-71b0-4c65-be53-73de33950324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:23.956065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c67a8fed-71b0-4c65-be53-73de33950324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:23.959207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf389f5-d10a-4c0d-924c-b8f487343079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:23.963768 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Volume 01801acc-999e-4e59-ba88-ced3b1ed63c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:00:23.965798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Cloning 01801acc-999e-4e59-ba88-ced3b1ed63c5 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:00:23.982008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:00:23.996242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 0, 23, 988832)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:00:23.997117 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:00:23.998068 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:00:24.005839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:00:24.005839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:00:24.012637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 0, 24, 9278)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:00:24.013236 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:00:24.013898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:00:24.052657 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:00:24.129319 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] creating snapshot='volume-01801acc-999e-4e59-ba88-ced3b1ed63c5.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:00:24.609682 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-01801acc-999e-4e59-ba88-ced3b1ed63c5.clone_snap' to 'volume-01801acc-999e-4e59-ba88-ced3b1ed63c5' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:00:24.836370 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:00:24.845029 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:00:24.845595 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:00:24.884760 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:00:24.885593 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Marking volume 01801acc-999e-4e59-ba88-ced3b1ed63c5 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:00:24.900783 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 01801acc-999e-4e59-ba88-ced3b1ed63c5. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:00:24.901234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Creating volume glance metadata for volume 01801acc-999e-4e59-ba88-ced3b1ed63c5 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:00:25.002814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf389f5-d10a-4c0d-924c-b8f487343079) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:25.006689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fdd4f5-167a-41fc-8ea5-cf599f986586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:00:25.018900 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Volume volume-01801acc-999e-4e59-ba88-ced3b1ed63c5 (01801acc-999e-4e59-ba88-ced3b1ed63c5): created successfully Nov 06 21:00:25.029557 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fdd4f5-167a-41fc-8ea5-cf599f986586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:00:25.033036 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Flow 'volume_create_manager' (cea9f0b8-1582-4e1b-a09f-f5eb1bea4358) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:00:25.049406 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-edb841d2-3324-4511-a051-5f8b2f91afd6 tempest-LiveMigrationTest-2007295791 None] Created volume successfully. Nov 06 21:00:28.475391 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 req-5bdf4fec-7352-42ec-89a1-063ab8e00518 tempest-LiveMigrationTest-2007295791 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:00:29.382970 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 req-5bdf4fec-7352-42ec-89a1-063ab8e00518 tempest-LiveMigrationTest-2007295791 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.908s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:00:29.383763 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 req-5bdf4fec-7352-42ec-89a1-063ab8e00518 tempest-LiveMigrationTest-2007295791 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '01801acc-999e-4e59-ba88-ced3b1ed63c5', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:00:29.422069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 req-5bdf4fec-7352-42ec-89a1-063ab8e00518 tempest-LiveMigrationTest-2007295791 None] Connection info returned from driver {'name': 'volumes/volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01801acc-999e-4e59-ba88-ced3b1ed63c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '8bf9de37-3202-4522-b37f-1468d2ee26bb'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:00:29.476236 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-4f616ac3-daa8-4de0-af97-71bcfbc0a7e2 req-5bdf4fec-7352-42ec-89a1-063ab8e00518 tempest-LiveMigrationTest-2007295791 None] attachment_update completed successfully. Nov 06 21:00:31.517813 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad req-04e03d49-2d8d-4499-9546-83df42a496f5 tempest-AttachVolumeShelveTestJSON-860784193 None] Terminate volume connection completed successfully. Nov 06 21:00:31.518462 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-da6c654c-6a75-4b8a-b3aa-f3ceaaebffad req-04e03d49-2d8d-4499-9546-83df42a496f5 tempest-AttachVolumeShelveTestJSON-860784193 None] Deleting attachment a7674afc-e9c6-4fbb-8c23-12d5375dfd02. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:00:49.973073 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-c48ec54d-d1e5-4dfc-80d4-4864520b8a24 tempest-LiveMigrationTest-2087109617 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:00:51.034194 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-c48ec54d-d1e5-4dfc-80d4-4864520b8a24 tempest-LiveMigrationTest-2087109617 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.060s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:00:51.035016 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-c48ec54d-d1e5-4dfc-80d4-4864520b8a24 tempest-LiveMigrationTest-2087109617 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '01801acc-999e-4e59-ba88-ced3b1ed63c5', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:00:51.078083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-c48ec54d-d1e5-4dfc-80d4-4864520b8a24 tempest-LiveMigrationTest-2087109617 None] Connection info returned from driver {'name': 'volumes/volume-01801acc-999e-4e59-ba88-ced3b1ed63c5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '01801acc-999e-4e59-ba88-ced3b1ed63c5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '489c6477-88b8-4c4f-a82f-42b9d9e8607d'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:00:51.183519 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-c48ec54d-d1e5-4dfc-80d4-4864520b8a24 tempest-LiveMigrationTest-2087109617 None] attachment_update completed successfully. Nov 06 21:00:58.683603 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-f2e5838a-1448-4329-b952-42f296b62aaa tempest-LiveMigrationTest-2087109617 None] Terminate volume connection completed successfully. Nov 06 21:00:58.684148 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-17a0b6f6-f104-4d18-850b-25a0bcb329da req-f2e5838a-1448-4329-b952-42f296b62aaa tempest-LiveMigrationTest-2087109617 None] Deleting attachment 8bf9de37-3202-4522-b37f-1468d2ee26bb. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:01:07.701095 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-b9233774-e08d-443b-b751-6d6994f6e651 req-cecbe99b-e81a-491d-b8ab-f68dc102e62c tempest-LiveMigrationTest-2007295791 None] Terminate volume connection completed successfully. Nov 06 21:01:07.702242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-b9233774-e08d-443b-b751-6d6994f6e651 req-cecbe99b-e81a-491d-b8ab-f68dc102e62c tempest-LiveMigrationTest-2007295791 None] Deleting attachment 489c6477-88b8-4c4f-a82f-42b9d9e8607d. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:01:07.906175 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-01801acc-999e-4e59-ba88-ced3b1ed63c5-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:01:07.963127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:08.120377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:01:08.135687 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] deleting rbd volume volume-01801acc-999e-4e59-ba88-ced3b1ed63c5 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:01:08.461818 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:01:08.503044 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] deleting parent snapshot volume-01801acc-999e-4e59-ba88-ced3b1ed63c5.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:01:09.692759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-52646cb2-a717-4fe2-97f2-d75adef114f7-delete_volume'" acquired by "delete_volume" :: waited 0.055s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:01:09.726466 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] Created reservations ['4691e641-a61c-4784-bb25-18e36bd5b6bd', '587badb2-6784-4cf4-b8c9-e4f0e1c1ac90', '12542941-1a9d-4bb1-a202-1d5e1e749885', '62681a08-1df5-4744-b487-82292d42d497'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:01:09.777557 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:09.849106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:01:09.849783 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Volume volume-52646cb2-a717-4fe2-97f2-d75adef114f7 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:01:09.861388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] deleting rbd volume volume-52646cb2-a717-4fe2-97f2-d75adef114f7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:01:09.933092 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.022367 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.094044 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:01:10.101244 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:01:10.109094 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.198083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.270900 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:01:10.309793 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] Deleted volume successfully. Nov 06 21:01:10.384205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-b9233774-e08d-443b-b751-6d6994f6e651 req-bfed0a1f-6412-4e6f-908a-e9166a33578b tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-01801acc-999e-4e59-ba88-ced3b1ed63c5-delete_volume'" released by "delete_volume" :: held 2.479s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:01:10.464037 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Created reservations ['1f6eb220-9070-4aac-aacf-463742169c00', '7f2571f6-ad32-40f8-bf85-8bc8c0583cfc', 'e8c89d0c-c2b5-4375-8d6f-37e927ff1630', 'cd7f689d-c0e0-4714-9bbc-4a4819f3908c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:01:10.554871 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.636732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:01:10.735142 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:01:10.741743 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Deleted volume successfully. Nov 06 21:01:10.761393 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8dbd2cce-4707-4268-abcb-a592ea3e31ce tempest-LiveMigrationTest-2007295791 None] Lock "b'cinder-52646cb2-a717-4fe2-97f2-d75adef114f7-delete_volume'" released by "delete_volume" :: held 1.069s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:02:10.097543 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:02:10.098265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:02:10.142968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:02:10.201585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:03:10.098759 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:03:10.099599 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:03:10.147586 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:03:10.184568 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:03:45.483517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:03:45.490099 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:03:45.491447 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:03:45.510200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Flow 'volume_create_manager' (9e62d58b-63dc-4747-9bdb-17eae45c44cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:03:45.514789 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c0b121-f278-45fd-b2f4-da29a5b820ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.524909 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:03:45.544622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c0b121-f278-45fd-b2f4-da29a5b820ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1712921010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9b64a67e-6923-49a0-aee9-6485b5c59a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0abfd854dfe46acaeedf288c6674c0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:03:45Z,use_quota=True,user_id='6f17807a206f49a1a165fe77aec4468c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.547149 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae136d62-2b5b-4480-ac6d-8bb5214fa378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.549366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae136d62-2b5b-4480-ac6d-8bb5214fa378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.551742 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a0d2ea-be1b-4639-b0ce-39e413632867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.554869 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a0d2ea-be1b-4639-b0ce-39e413632867) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b64a67e-6923-49a0-aee9-6485b5c59a82', 'volume_name': 'volume-9b64a67e-6923-49a0-aee9-6485b5c59a82', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.558740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dceb03-f995-49f2-b6d2-5e80374ac91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.562885 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2dceb03-f995-49f2-b6d2-5e80374ac91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.566391 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47224274-09e8-4e3f-b88a-4512a836957e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.567244 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Volume 9b64a67e-6923-49a0-aee9-6485b5c59a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b64a67e-6923-49a0-aee9-6485b5c59a82', 'volume_size': 1} Nov 06 21:03:45.567636 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] creating volume 'volume-9b64a67e-6923-49a0-aee9-6485b5c59a82' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:03:45.568821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:03:45.692635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:03:45.693011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:03:45.694988 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47224274-09e8-4e3f-b88a-4512a836957e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b64a67e-6923-49a0-aee9-6485b5c59a82', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.697145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67da962-4ef3-4dda-ab79-9c392dfb5593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:03:45.723810 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Volume volume-9b64a67e-6923-49a0-aee9-6485b5c59a82 (9b64a67e-6923-49a0-aee9-6485b5c59a82): created successfully Nov 06 21:03:45.726076 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67da962-4ef3-4dda-ab79-9c392dfb5593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:03:45.729242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Flow 'volume_create_manager' (9e62d58b-63dc-4747-9bdb-17eae45c44cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:03:45.747109 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a3aba072-fd40-42ef-b217-8c3de9d10e92 tempest-AttachVolumeShelveTestJSON-860784193 None] Created volume successfully. Nov 06 21:04:10.095527 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:04:10.097763 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:10.182042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:10.279584 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:04:32.340521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:04:32.371605 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:04:32.372066 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:04:32.409492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Flow 'volume_create_manager' (eaea53f4-9f0e-48a5-8a60-19feed170b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:04:32.437197 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b4f19-9f4d-4e4e-98f1-bebc01dfe92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.471441 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:04:32.492048 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474b4f19-9f4d-4e4e-98f1-bebc01dfe92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:04:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-711889288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5104c4cd-a1b4-49a7-bb16-8de397ad2092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a348daabdd46089d7f635ca36b9f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:04:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:04:32Z,use_quota=True,user_id='54f0d0ae2ec04c7d83345adde94ecfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.496277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a65a93-bb74-4656-8535-b6c41e7dbe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.508320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46a65a93-bb74-4656-8535-b6c41e7dbe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.510986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e498ba-79cf-4a0c-8a5a-34bcdbe41eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.520313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e498ba-79cf-4a0c-8a5a-34bcdbe41eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'volume_name': 'volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.523049 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e94174-2bda-4572-8038-0cb6294141a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.525681 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01e94174-2bda-4572-8038-0cb6294141a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.534042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efacc01-664d-4be5-a781-595bd70c77be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.537795 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Volume 5104c4cd-a1b4-49a7-bb16-8de397ad2092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'volume_size': 1} Nov 06 21:04:32.538429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] creating volume 'volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:04:32.539622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:32.676560 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:04:32.677238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:04:32.679381 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4efacc01-664d-4be5-a781-595bd70c77be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.682057 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c589e2-3fdd-4013-956f-3327c548bb19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:32.704245 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Volume volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092 (5104c4cd-a1b4-49a7-bb16-8de397ad2092): created successfully Nov 06 21:04:32.706952 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31c589e2-3fdd-4013-956f-3327c548bb19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:32.719533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Flow 'volume_create_manager' (eaea53f4-9f0e-48a5-8a60-19feed170b42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:04:32.741897 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-20536ebf-cdbc-4ff2-bdd5-04ee6de9c0af tempest-VolumesAdminNegativeTest-1108999452 None] Created volume successfully. Nov 06 21:04:34.223953 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-10df4254-4e60-4b32-a0be-c287b34a73cd req-be53fa91-f454-474e-a7cf-eacd951cb31e tempest-VolumesAdminNegativeTest-1108999452 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:04:35.913616 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-10df4254-4e60-4b32-a0be-c287b34a73cd req-be53fa91-f454-474e-a7cf-eacd951cb31e tempest-VolumesAdminNegativeTest-1108999452 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.689s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:04:35.914518 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-10df4254-4e60-4b32-a0be-c287b34a73cd req-be53fa91-f454-474e-a7cf-eacd951cb31e tempest-VolumesAdminNegativeTest-1108999452 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:04:35.957562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-10df4254-4e60-4b32-a0be-c287b34a73cd req-be53fa91-f454-474e-a7cf-eacd951cb31e tempest-VolumesAdminNegativeTest-1108999452 None] Connection info returned from driver {'name': 'volumes/volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5104c4cd-a1b4-49a7-bb16-8de397ad2092', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7a0a52ec-acde-4d5d-b803-06dc8cad0cae'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:04:36.058498 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-10df4254-4e60-4b32-a0be-c287b34a73cd req-be53fa91-f454-474e-a7cf-eacd951cb31e tempest-VolumesAdminNegativeTest-1108999452 None] attachment_update completed successfully. Nov 06 21:04:40.698701 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-c15fc66c-6547-4805-87c7-199d7ebd101c req-0c783fdf-9b4d-443c-8271-90045e8fc8e5 tempest-VolumesAdminNegativeTest-1108999452 None] Terminate volume connection completed successfully. Nov 06 21:04:40.700077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-c15fc66c-6547-4805-87c7-199d7ebd101c req-0c783fdf-9b4d-443c-8271-90045e8fc8e5 tempest-VolumesAdminNegativeTest-1108999452 None] Deleting attachment 7a0a52ec-acde-4d5d-b803-06dc8cad0cae. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:04:42.435189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:04:42.444878 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:04:42.448411 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:04:42.490985 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Flow 'volume_create_manager' (df57e961-ec48-414a-8aa9-249225c3f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:04:42.499533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9ae0c-98a2-45b0-b7b5-f62d6cbcc3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.545223 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:04:42.565709 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be9ae0c-98a2-45b0-b7b5-f62d6cbcc3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-785917035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7067467a-0595-42c6-be1b-b1b0a45a83c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4a348daabdd46089d7f635ca36b9f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:04:42Z,use_quota=True,user_id='54f0d0ae2ec04c7d83345adde94ecfeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.568501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9f391f-e704-40ec-8ae3-b5456488e6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.570799 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e9f391f-e704-40ec-8ae3-b5456488e6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.573916 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cf4543-36d6-473f-a685-1d3700e3d62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.578548 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14cf4543-36d6-473f-a685-1d3700e3d62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7067467a-0595-42c6-be1b-b1b0a45a83c4', 'volume_name': 'volume-7067467a-0595-42c6-be1b-b1b0a45a83c4', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.583038 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df97b457-f676-4f25-9abe-6d1cfb6e8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.585911 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df97b457-f676-4f25-9abe-6d1cfb6e8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.589432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289baa4c-8b09-4742-afc3-6f9fbcadb183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.590456 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Volume 7067467a-0595-42c6-be1b-b1b0a45a83c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7067467a-0595-42c6-be1b-b1b0a45a83c4', 'volume_size': 1} Nov 06 21:04:42.591034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] creating volume 'volume-7067467a-0595-42c6-be1b-b1b0a45a83c4' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:04:42.592721 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:42.744477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:04:42.745082 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:04:42.750571 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (289baa4c-8b09-4742-afc3-6f9fbcadb183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7067467a-0595-42c6-be1b-b1b0a45a83c4', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.755166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d4bbc-ad37-46cf-a996-81af14cf83a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:04:42.790895 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Volume volume-7067467a-0595-42c6-be1b-b1b0a45a83c4 (7067467a-0595-42c6-be1b-b1b0a45a83c4): created successfully Nov 06 21:04:42.799240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a0d4bbc-ad37-46cf-a996-81af14cf83a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:04:42.802725 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Flow 'volume_create_manager' (df57e961-ec48-414a-8aa9-249225c3f04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:04:42.827153 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7ec9b658-f3dd-4bd0-9e32-b3d9fa14abcb tempest-VolumesAdminNegativeTest-1108999452 None] Created volume successfully. Nov 06 21:04:44.938484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Lock "b'cinder-7067467a-0595-42c6-be1b-b1b0a45a83c4-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:04:45.058410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:45.180592 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:04:45.181111 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Volume volume-7067467a-0595-42c6-be1b-b1b0a45a83c4 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:04:45.193764 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] deleting rbd volume volume-7067467a-0595-42c6-be1b-b1b0a45a83c4 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:04:45.655129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Created reservations ['5c81a1a1-d50d-4dc8-8e58-ae3e4083d337', 'a4984452-b095-4b15-8e28-7d740b46ef9b', '23e8984e-de4b-4e8c-bb47-4782b4560e1c', '14931976-8054-454c-b682-be559925de73'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:04:45.743290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:45.824955 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:45.877925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:04:45.895623 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Deleted volume successfully. Nov 06 21:04:45.925149 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-612ac978-4d23-4eff-a047-576f19831155 tempest-VolumesAdminNegativeTest-1108999452 None] Lock "b'cinder-7067467a-0595-42c6-be1b-b1b0a45a83c4-delete_volume'" released by "delete_volume" :: held 0.986s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:04:46.077688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c req-8d025e7f-b557-4575-8289-0c297012efba tempest-AttachVolumeShelveTestJSON-860784193 None] No connector for attachment 9bda977b-fd24-4c8c-aebd-a3e0bb7eb07f; skipping storage backend terminate_connection call. {{(pid=127482) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4899}} Nov 06 21:04:46.078398 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-d161afbc-ffcb-4b82-a7fb-e68a3612f13c req-8d025e7f-b557-4575-8289-0c297012efba tempest-AttachVolumeShelveTestJSON-860784193 None] Deleting attachment 9bda977b-fd24-4c8c-aebd-a3e0bb7eb07f. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:04:46.308509 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Lock "b'cinder-5104c4cd-a1b4-49a7-bb16-8de397ad2092-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:04:46.417941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:46.541078 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:04:46.541707 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Volume volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:04:46.554468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] deleting rbd volume volume-5104c4cd-a1b4-49a7-bb16-8de397ad2092 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:04:47.084028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Created reservations ['f7f35ce4-ec51-406a-8961-61bdabc448b3', '06bcf73c-54fd-4b67-bc48-d9cde0215287', 'd091f82f-667a-4f34-9df9-e14638321c99', 'ba3c0bab-cc33-4d2f-a13e-bab9d3c86e44'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:04:47.199432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:47.267730 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:04:47.364975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:04:47.379910 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Deleted volume successfully. Nov 06 21:04:47.414111 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-61db8d12-ebe1-406e-9038-d855226191cb tempest-VolumesAdminNegativeTest-1108999452 None] Lock "b'cinder-5104c4cd-a1b4-49a7-bb16-8de397ad2092-delete_volume'" released by "delete_volume" :: held 1.106s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:05:10.095355 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:05:10.097077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:10.131685 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:10.191206 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:05:28.899048 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:05:28.906832 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:05:28.907596 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:05:28.924305 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Flow 'volume_create_manager' (140ab4ad-307b-41e0-aac5-bcaf964f13a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:28.928623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9e9af6-1e31-41c5-91fc-5419fb84cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:28.937518 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:05:28.953925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9e9af6-1e31-41c5-91fc-5419fb84cede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:05:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1579056925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea8948c4-56a9-4b90-be7d-8167c726ff4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b329a5d392d34cbdb49ca77c4dac5ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:05:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:05:29Z,use_quota=True,user_id='56fcc02f90c34bb0a1e1467be68e9925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:28.957261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff3ccf-ea07-4a75-8184-7a0f7deb94d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:28.960232 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aff3ccf-ea07-4a75-8184-7a0f7deb94d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:28.963271 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e41fd4d-7c26-4684-ac37-5f6064521390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:28.966261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e41fd4d-7c26-4684-ac37-5f6064521390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea8948c4-56a9-4b90-be7d-8167c726ff4b', 'volume_name': 'volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:28.969868 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36d62fa-cc0f-44a2-b8b6-c812ae2fb855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:28.972051 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c36d62fa-cc0f-44a2-b8b6-c812ae2fb855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:28.975054 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdbda4d-378e-4da1-a5cf-2abb2587ca08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:28.976145 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume ea8948c4-56a9-4b90-be7d-8167c726ff4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b', 'volume_size': 1} Nov 06 21:05:28.976769 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] creating volume 'volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:05:28.978521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:29.116867 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:05:29.117504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:05:29.119782 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcdbda4d-378e-4da1-a5cf-2abb2587ca08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:29.122263 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4755fae0-04cf-4b02-b189-9ee76ef35da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:29.142409 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b (ea8948c4-56a9-4b90-be7d-8167c726ff4b): created successfully Nov 06 21:05:29.144835 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4755fae0-04cf-4b02-b189-9ee76ef35da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:29.147937 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Flow 'volume_create_manager' (140ab4ad-307b-41e0-aac5-bcaf964f13a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:29.165103 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-90a9484a-c5da-4978-95d1-518d6d56e460 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Created volume successfully. Nov 06 21:05:30.193259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Lock "b'cinder-ea8948c4-56a9-4b90-be7d-8167c726ff4b-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:05:30.289128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:30.347876 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:05:30.348481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:05:30.361230 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] deleting rbd volume volume-ea8948c4-56a9-4b90-be7d-8167c726ff4b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:05:30.928187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Created reservations ['0bf2a919-7503-49a6-b89c-f2515b0b4fad', '09ed8037-0ad6-4828-bae9-351bd2a56f9c', '0e6cf955-eb75-493d-86e8-d907d2f23a9b', 'd961fe31-7a51-4cbc-a99f-ce7d85a678ee'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:05:31.033152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:31.092370 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:31.152895 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:05:31.161394 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Deleted volume successfully. Nov 06 21:05:31.198066 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-b2892673-5d42-487d-83a5-50255f52584d tempest-VolumeQuotasAdminTestJSON-1236682153 None] Lock "b'cinder-ea8948c4-56a9-4b90-be7d-8167c726ff4b-delete_volume'" released by "delete_volume" :: held 1.005s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:05:31.935077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:05:31.941221 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:05:31.942140 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:05:31.971676 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Flow 'volume_create_manager' (049b0272-2689-4a96-92c6-5751bee9211d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:31.979493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0942a0-afba-411e-a568-f1cd9276a5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.001179 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:05:32.071649 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0942a0-afba-411e-a568-f1cd9276a5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:05:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-41540980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=62969d99-f3d8-4779-b448-b1ab8083ab65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b329a5d392d34cbdb49ca77c4dac5ecd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:05:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:05:32Z,use_quota=True,user_id='56fcc02f90c34bb0a1e1467be68e9925',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.079238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b014e0ec-85c3-4170-99b3-c529fcfc2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.089018 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b014e0ec-85c3-4170-99b3-c529fcfc2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.091396 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb25970-3ffd-4be1-ac3d-4492e571c90d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.093684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb25970-3ffd-4be1-ac3d-4492e571c90d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62969d99-f3d8-4779-b448-b1ab8083ab65', 'volume_name': 'volume-62969d99-f3d8-4779-b448-b1ab8083ab65', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.095866 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bff6538-db8e-4894-b5bd-0b24c891a40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.097905 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bff6538-db8e-4894-b5bd-0b24c891a40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.110588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128219e-33eb-4309-9727-9a3a602bb9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.114139 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume 62969d99-f3d8-4779-b448-b1ab8083ab65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62969d99-f3d8-4779-b448-b1ab8083ab65', 'volume_size': 1} Nov 06 21:05:32.114546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] creating volume 'volume-62969d99-f3d8-4779-b448-b1ab8083ab65' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:05:32.119532 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:32.268116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:05:32.269249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:05:32.271404 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a128219e-33eb-4309-9727-9a3a602bb9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62969d99-f3d8-4779-b448-b1ab8083ab65', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.273791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3264aea-5632-4129-a736-eb82ac8cf2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:32.291646 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Volume volume-62969d99-f3d8-4779-b448-b1ab8083ab65 (62969d99-f3d8-4779-b448-b1ab8083ab65): created successfully Nov 06 21:05:32.294390 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3264aea-5632-4129-a736-eb82ac8cf2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:32.297968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Flow 'volume_create_manager' (049b0272-2689-4a96-92c6-5751bee9211d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:32.317858 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-00a787e4-d85c-4f69-84d3-0694ebd31c46 tempest-VolumeQuotasAdminTestJSON-1236682153 None] Created volume successfully. Nov 06 21:05:33.843678 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-009d0c2f-7364-4963-898f-9d982ba6651c tempest-VolumeQuotasAdminTestJSON-929763832 None] Transfer volume completed successfully. Nov 06 21:05:34.319497 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Lock "b'cinder-62969d99-f3d8-4779-b448-b1ab8083ab65-delete_volume'" acquired by "delete_volume" :: waited 0.020s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:05:34.347025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:34.402069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:05:34.402709 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Volume volume-62969d99-f3d8-4779-b448-b1ab8083ab65 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:05:34.416683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] deleting rbd volume volume-62969d99-f3d8-4779-b448-b1ab8083ab65 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:05:34.771744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Created reservations ['73496411-6494-4179-b7cd-c1f0473fd7d3', '587f321f-acec-4c28-a2a1-065029130cdb', '6ce92250-1a54-47a4-aca2-8456944ec625', '51a479ab-a606-4ded-8797-8423b1d6dfa8'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:05:34.826816 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:34.926280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:34.977693 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:05:34.995554 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Deleted volume successfully. Nov 06 21:05:35.026366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-10fc6605-41d3-47ad-ac1e-145e5ea0e3bc tempest-VolumeQuotasAdminTestJSON-193485426 None] Lock "b'cinder-62969d99-f3d8-4779-b448-b1ab8083ab65-delete_volume'" released by "delete_volume" :: held 0.707s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:05:43.795632 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:05:43.801086 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:05:43.801725 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:05:43.817948 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (cf39678e-30ff-4a41-ac40-7d1160a7baf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:43.828653 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296502e9-9fa8-405a-8b70-8caa2fdc4b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:43.860465 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:05:43.902690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (296502e9-9fa8-405a-8b70-8caa2fdc4b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1638093189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=b42fdfd4-1349-458d-819b-36de88c750f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05627a2721154c24af84b804afe5a081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:05:44Z,use_quota=True,user_id='cfdaf58c19864bddb7f1bbda9fcf3aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:43.910692 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a0eca2-c0eb-4b60-8b73-f9db44570bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:43.921475 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00a0eca2-c0eb-4b60-8b73-f9db44570bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:43.924905 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19db7f3-997c-46f2-86e0-9e643c26fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:43.927640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19db7f3-997c-46f2-86e0-9e643c26fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b42fdfd4-1349-458d-819b-36de88c750f8', 'volume_name': 'volume-b42fdfd4-1349-458d-819b-36de88c750f8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:43.930901 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480bde2e-f83b-4dd0-8c9a-ffd33beacc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:43.934826 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480bde2e-f83b-4dd0-8c9a-ffd33beacc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:43.938260 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf009ca-9377-4b72-81bc-4eb69a47cc34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:43.940825 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Volume b42fdfd4-1349-458d-819b-36de88c750f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b42fdfd4-1349-458d-819b-36de88c750f8', 'volume_size': 1} Nov 06 21:05:43.941400 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] creating volume 'volume-b42fdfd4-1349-458d-819b-36de88c750f8' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:05:43.942540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:44.077910 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:05:44.078628 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:05:44.081481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf009ca-9377-4b72-81bc-4eb69a47cc34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b42fdfd4-1349-458d-819b-36de88c750f8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.084695 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f244d2d7-c9f6-463b-8ab0-30cfed5929ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.097423 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-b42fdfd4-1349-458d-819b-36de88c750f8 (b42fdfd4-1349-458d-819b-36de88c750f8): created successfully Nov 06 21:05:44.100528 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f244d2d7-c9f6-463b-8ab0-30cfed5929ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.107708 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (cf39678e-30ff-4a41-ac40-7d1160a7baf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:44.138167 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2905de67-b35d-4454-91e9-17ea3678ce8c tempest-VolumesBackupsAdminTest-530643389 None] Created volume successfully. Nov 06 21:05:44.308896 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:05:44.321226 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:05:44.322967 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:05:44.353560 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Flow 'volume_create_manager' (17a5b495-cca3-49b9-a10e-f915b2965e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:44.359925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a46409f-c815-4d3a-b148-72b26e509137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.369157 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:05:44.399006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a46409f-c815-4d3a-b148-72b26e509137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:05:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2115474553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=638379a3-bc48-41a4-a0c4-976ee1563a2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='23c3196631494be38ca11b2167bbc4bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:05:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:05:44Z,use_quota=True,user_id='b51fe86b5589475da23e549e5e4128aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.401637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7226acca-b301-47a9-b44d-547347e331cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.403740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7226acca-b301-47a9-b44d-547347e331cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.407262 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738a1a52-5b69-461b-841f-c3b280279bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.549420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (738a1a52-5b69-461b-841f-c3b280279bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '638379a3-bc48-41a4-a0c4-976ee1563a2c', 'volume_name': 'volume-638379a3-bc48-41a4-a0c4-976ee1563a2c', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.551933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d35dcf6-3df5-496d-a2a2-9fe890907bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.554304 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d35dcf6-3df5-496d-a2a2-9fe890907bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:44.556622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da008b6-e60c-44e5-92fd-6b199e5859aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:44.558012 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Volume 638379a3-bc48-41a4-a0c4-976ee1563a2c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-638379a3-bc48-41a4-a0c4-976ee1563a2c', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:05:44.558671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Cloning 638379a3-bc48-41a4-a0c4-976ee1563a2c from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:05:44.576863 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.017s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:05:44.587031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 5, 44, 581280)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:05:44.587633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:05:44.588276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:05:44.594310 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:05:44.595355 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:05:44.602449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 5, 44, 599391)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:05:44.602971 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:05:44.603369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:05:44.626282 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:44.730110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] creating snapshot='volume-638379a3-bc48-41a4-a0c4-976ee1563a2c.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:05:45.628970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-638379a3-bc48-41a4-a0c4-976ee1563a2c.clone_snap' to 'volume-638379a3-bc48-41a4-a0c4-976ee1563a2c' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:05:45.821348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:05:45.828240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:05:45.828634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:05:45.858102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:05:45.859809 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Marking volume 638379a3-bc48-41a4-a0c4-976ee1563a2c as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:05:45.869928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 638379a3-bc48-41a4-a0c4-976ee1563a2c. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:05:45.870362 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Creating volume glance metadata for volume 638379a3-bc48-41a4-a0c4-976ee1563a2c backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:05:45.942498 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2da008b6-e60c-44e5-92fd-6b199e5859aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638379a3-bc48-41a4-a0c4-976ee1563a2c', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:45.945255 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e771e133-45b3-4ccb-8386-088a907328a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:45.953509 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Volume volume-638379a3-bc48-41a4-a0c4-976ee1563a2c (638379a3-bc48-41a4-a0c4-976ee1563a2c): created successfully Nov 06 21:05:45.955833 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e771e133-45b3-4ccb-8386-088a907328a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:45.958733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Flow 'volume_create_manager' (17a5b495-cca3-49b9-a10e-f915b2965e3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:45.966955 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-df6d9b28-17f4-4389-a37d-60860dedde0c tempest-ServersTestBootFromVolume-1142499360 None] Created volume successfully. Nov 06 21:05:48.553574 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:05:49.653466 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-ca390cd2-761c-45dd-b92c-27e9ca982f9e req-d9fcd69b-f9f3-42b6-a064-7448a55e7b3c tempest-ServersTestBootFromVolume-1142499360 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:05:49.680926 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.135s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:05:49.683403 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-b42fdfd4-1349-458d-819b-36de88c750f8', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'b42fdfd4-1349-458d-819b-36de88c750f8', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:05:49.722094 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] Initialize volume connection completed successfully. Nov 06 21:05:50.514008 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-ca390cd2-761c-45dd-b92c-27e9ca982f9e req-d9fcd69b-f9f3-42b6-a064-7448a55e7b3c tempest-ServersTestBootFromVolume-1142499360 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.860s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:05:50.516283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ca390cd2-761c-45dd-b92c-27e9ca982f9e req-d9fcd69b-f9f3-42b6-a064-7448a55e7b3c tempest-ServersTestBootFromVolume-1142499360 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-638379a3-bc48-41a4-a0c4-976ee1563a2c', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '638379a3-bc48-41a4-a0c4-976ee1563a2c', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:05:50.553563 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-ca390cd2-761c-45dd-b92c-27e9ca982f9e req-d9fcd69b-f9f3-42b6-a064-7448a55e7b3c tempest-ServersTestBootFromVolume-1142499360 None] Connection info returned from driver {'name': 'volumes/volume-638379a3-bc48-41a4-a0c4-976ee1563a2c', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '638379a3-bc48-41a4-a0c4-976ee1563a2c', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'd639ac71-2670-45ae-9b50-69bb91291024'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:05:50.657404 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-ca390cd2-761c-45dd-b92c-27e9ca982f9e req-d9fcd69b-f9f3-42b6-a064-7448a55e7b3c tempest-ServersTestBootFromVolume-1142499360 None] attachment_update completed successfully. Nov 06 21:05:54.103852 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] Terminate volume connection completed successfully. Nov 06 21:05:54.126599 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-657fccb3-b486-491c-99aa-1d287a499f87 tempest-VolumesBackupsAdminTest-530643389 None] Remove volume export completed successfully. Nov 06 21:05:56.652985 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:05:56.659500 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:05:56.660382 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:05:56.677350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (72dfde85-fbda-44cd-a5ad-817f17fdd86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:56.681431 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a23f6c2-940d-46d2-9967-8c8c609109cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.691934 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:05:56.705542 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a23f6c2-940d-46d2-9967-8c8c609109cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:05:56Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_f35d0d25-156b-4c86-8d77-c7980f4e5221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ad7edb44-5c1d-4563-80e5-bf2f04d8b469,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05627a2721154c24af84b804afe5a081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:05:57Z,use_quota=True,user_id='cfdaf58c19864bddb7f1bbda9fcf3aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.708521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4460dbb6-800f-4a84-ad5c-7538515cf884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.710826 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4460dbb6-800f-4a84-ad5c-7538515cf884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.713183 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0599052-f59b-41ac-bc90-593e31d0c684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.715611 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0599052-f59b-41ac-bc90-593e31d0c684) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'volume_name': 'volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.718089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6105ce13-3b5a-4c74-981d-c1ad455fc56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.720634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6105ce13-3b5a-4c74-981d-c1ad455fc56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.722947 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b652af1c-7d28-49d5-8c91-8bc0f9d0933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.723907 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Volume ad7edb44-5c1d-4563-80e5-bf2f04d8b469: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'volume_size': 1} Nov 06 21:05:56.724522 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] creating volume 'volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:05:56.725787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:05:56.811208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:05:56.811679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:05:56.814127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b652af1c-7d28-49d5-8c91-8bc0f9d0933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.816625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09a5994-d38f-4ada-9f66-69b8a43c5982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:05:56.826820 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469 (ad7edb44-5c1d-4563-80e5-bf2f04d8b469): created successfully Nov 06 21:05:56.829014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09a5994-d38f-4ada-9f66-69b8a43c5982) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:05:56.831825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (72dfde85-fbda-44cd-a5ad-817f17fdd86e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:05:56.840364 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Created volume successfully. Nov 06 21:05:57.774647 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:05:58.565276 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.790s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:05:58.566075 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ad7edb44-5c1d-4563-80e5-bf2f04d8b469', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:05:58.580962 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Initialize volume connection completed successfully. Nov 06 21:05:59.775970 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Terminate volume connection completed successfully. Nov 06 21:05:59.793150 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4993a93e-0b87-42d5-9d97-039b5b4dbaf0 tempest-VolumesBackupsAdminTest-530643389 None] Remove volume export completed successfully. Nov 06 21:06:00.961951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-ad7edb44-5c1d-4563-80e5-bf2f04d8b469-delete_volume'" acquired by "delete_volume" :: waited 0.027s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:01.021586 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:01.691699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:01.709623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] deleting rbd volume volume-ad7edb44-5c1d-4563-80e5-bf2f04d8b469 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:02.088877 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5a86370a-adad-44dd-a66f-80360c776adc tempest-GroupsV320Test-1551555626 None] Group tempest-GroupsV320Test-Group-252507692: creating Nov 06 21:06:02.146556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Created reservations ['dc8ae647-43d2-440f-b32f-368b65a3ace0', '3ff1917d-713d-4f11-bc16-02264c5dd86c', 'f93fdc80-8b0f-4fcd-9d6d-83a6de3a078d', '1cfdc5fc-d49d-49f6-a2b3-f0cc88c351b9'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:02.155421 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5a86370a-adad-44dd-a66f-80360c776adc tempest-GroupsV320Test-1551555626 None] Group tempest-GroupsV320Test-Group-252507692: created successfully Nov 06 21:06:02.172859 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5a86370a-adad-44dd-a66f-80360c776adc tempest-GroupsV320Test-1551555626 None] Create group completed successfully. Nov 06 21:06:02.256803 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:02.335738 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:02.414423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:02.420750 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Deleted volume successfully. Nov 06 21:06:02.437371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e7ed7f2a-f0e8-47a5-a853-ad3aa160cdb7 tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-ad7edb44-5c1d-4563-80e5-bf2f04d8b469-delete_volume'" released by "delete_volume" :: held 1.475s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:03.680278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-1b4c5896-cf38-4da6-8909-b5c5f74d7884 tempest-GroupsV320Test-1551555626 None] Created reservations ['c10566d2-c458-4023-8c26-86f90d57fad8'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:03.722854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1b4c5896-cf38-4da6-8909-b5c5f74d7884 tempest-GroupsV320Test-1551555626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:03.755704 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1b4c5896-cf38-4da6-8909-b5c5f74d7884 tempest-GroupsV320Test-1551555626 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:03.789088 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-1b4c5896-cf38-4da6-8909-b5c5f74d7884 tempest-GroupsV320Test-1551555626 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:03.793495 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1b4c5896-cf38-4da6-8909-b5c5f74d7884 tempest-GroupsV320Test-1551555626 None] Delete group completed successfully. Nov 06 21:06:04.611568 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:04.615247 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:04.615713 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:04.627543 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (d3bb4ff4-6e92-462f-aaa8-d3474e373b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:04.630994 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f752b19-474d-4011-a09b-1ecab2b68775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.646793 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:04.665890 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f752b19-474d-4011-a09b-1ecab2b68775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsAdminTest-Volume-1955107854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e40133c0-f602-49cc-9afc-5ba557a58961,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05627a2721154c24af84b804afe5a081',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:05Z,use_quota=True,user_id='cfdaf58c19864bddb7f1bbda9fcf3aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.669254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f7e4ca-ac6c-4d7f-9e8c-ad0be5f71642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.672715 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46f7e4ca-ac6c-4d7f-9e8c-ad0be5f71642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.675236 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0152d68-cec7-421a-a31b-61da6b56dd82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.677543 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0152d68-cec7-421a-a31b-61da6b56dd82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e40133c0-f602-49cc-9afc-5ba557a58961', 'volume_name': 'volume-e40133c0-f602-49cc-9afc-5ba557a58961', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.680435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32898f8-f2ed-4631-a493-c463c4ba3993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.682725 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32898f8-f2ed-4631-a493-c463c4ba3993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.689287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ec3bb5-1362-46e1-9de1-773a3976df5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.690517 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Volume e40133c0-f602-49cc-9afc-5ba557a58961: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e40133c0-f602-49cc-9afc-5ba557a58961', 'volume_size': 1} Nov 06 21:06:04.690517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] creating volume 'volume-e40133c0-f602-49cc-9afc-5ba557a58961' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:04.691789 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:04.768415 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:04.768949 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:04.771246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71ec3bb5-1362-46e1-9de1-773a3976df5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e40133c0-f602-49cc-9afc-5ba557a58961', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.774600 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3176b475-1f54-4a90-b87e-8ff1bdb54e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:04.784723 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-e40133c0-f602-49cc-9afc-5ba557a58961 (e40133c0-f602-49cc-9afc-5ba557a58961): created successfully Nov 06 21:06:04.787997 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3176b475-1f54-4a90-b87e-8ff1bdb54e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:04.791013 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Flow 'volume_create_manager' (d3bb4ff4-6e92-462f-aaa8-d3474e373b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:04.801123 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-475c8e61-23be-425a-b9a2-6f5d7b97bcc6 tempest-VolumesBackupsAdminTest-530643389 None] Created volume successfully. Nov 06 21:06:05.970651 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:06:06.778453 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.804s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:06:06.781224 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e40133c0-f602-49cc-9afc-5ba557a58961', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'e40133c0-f602-49cc-9afc-5ba557a58961', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:06:06.830247 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] Initialize volume connection completed successfully. Nov 06 21:06:08.269856 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:08.274597 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:08.275346 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:08.290523 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Flow 'volume_create_manager' (a5fef58e-b0a7-4c2c-8060-cf826a309764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:08.294010 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3fc723-b17b-42f1-84fa-4be048e20b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.302072 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:08.315476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f3fc723-b17b-42f1-84fa-4be048e20b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1095116832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d06fa1f8-1506-4e82-ba23-b8c0f72b27fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fcd41b282af4b6f818ab3b53644cd73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:08Z,use_quota=True,user_id='3bfbeb6eb7b14069ac7b1c9aefbd3b56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.319203 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04bb31c-457d-4e25-ae9c-e2c78ea67456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.321333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e04bb31c-457d-4e25-ae9c-e2c78ea67456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.323975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4dc032-275f-4be1-9e21-be9a02349292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.326495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb4dc032-275f-4be1-9e21-be9a02349292) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd06fa1f8-1506-4e82-ba23-b8c0f72b27fa', 'volume_name': 'volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.329237 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcc2c9a-3651-4b4e-adc8-50964a54f4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.331881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfcc2c9a-3651-4b4e-adc8-50964a54f4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.334119 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c64870-b60a-47c0-81b7-04d31d744398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.334963 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Volume d06fa1f8-1506-4e82-ba23-b8c0f72b27fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa', 'volume_size': 1} Nov 06 21:06:08.335438 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] creating volume 'volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:08.336645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:08.428016 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:08.428736 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:08.431418 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c64870-b60a-47c0-81b7-04d31d744398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.434554 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a1858b-75e2-420f-bba2-23d4e08e62d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:08.453303 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Volume volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa (d06fa1f8-1506-4e82-ba23-b8c0f72b27fa): created successfully Nov 06 21:06:08.455216 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38a1858b-75e2-420f-bba2-23d4e08e62d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:08.461562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Flow 'volume_create_manager' (a5fef58e-b0a7-4c2c-8060-cf826a309764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:08.473403 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-37bb2e14-2e91-4565-83d5-fac73b3fc606 tempest-SnapshotsActionsTest-1152980065 None] Created volume successfully. Nov 06 21:06:09.027003 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] Terminate volume connection completed successfully. Nov 06 21:06:09.042540 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-92b7c63f-4c29-45ab-aec6-a49710472374 tempest-VolumesBackupsAdminTest-530643389 None] Remove volume export completed successfully. Nov 06 21:06:09.520287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-966d89b3-f483-4b72-aaec-4541b3c3253a tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:09.963594 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-966d89b3-f483-4b72-aaec-4541b3c3253a tempest-SnapshotsActionsTest-1152980065 None] Create snapshot completed successfully Nov 06 21:06:10.098472 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:06:10.100351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:10.167896 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:10.242443 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:11.414203 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6c1f8a97-6df6-4f0d-87c9-32cf8f08ed6c tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:11.910225 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6c1f8a97-6df6-4f0d-87c9-32cf8f08ed6c tempest-SnapshotsActionsTest-1152980065 None] Create snapshot completed successfully Nov 06 21:06:12.354754 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-e40133c0-f602-49cc-9afc-5ba557a58961-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:12.404661 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:12.927586 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-e40133c0-f602-49cc-9afc-5ba557a58961 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:12.938983 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] deleting rbd volume volume-e40133c0-f602-49cc-9afc-5ba557a58961 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:12.952313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8848d86f-160a-443c-888b-9e31227fca6f tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-93fe9733-c210-4da6-a255-6f6a336d2e66-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:12.953732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8848d86f-160a-443c-888b-9e31227fca6f tempest-SnapshotsActionsTest-696006644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:13.136612 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Created reservations ['0ac3ef8b-c34f-4f75-a5a0-e4f6a9d04691', '95f138e0-f406-459b-966d-22e6742b7efb', '86761951-8ee2-478a-8781-ea4340489ae3', '117bd8a1-e004-4760-be39-e796a03afe4e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:13.177350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:13.203353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:13.232732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:13.237336 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Deleted volume successfully. Nov 06 21:06:13.252280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d04c04cc-fb8c-4daa-bd88-b6b7aa130070 tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-e40133c0-f602-49cc-9afc-5ba557a58961-delete_volume'" released by "delete_volume" :: held 0.898s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:13.535034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-b42fdfd4-1349-458d-819b-36de88c750f8-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:13.573908 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:13.941870 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Volume volume-b42fdfd4-1349-458d-819b-36de88c750f8 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:13.956759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] deleting rbd volume volume-b42fdfd4-1349-458d-819b-36de88c750f8 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:14.017640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8848d86f-160a-443c-888b-9e31227fca6f tempest-SnapshotsActionsTest-696006644 None] Created reservations ['d2fcd089-cfa5-4da6-96ff-b85b50831fb7', '49fc0905-f8ed-4328-8c27-d0fab00ab430', 'b3d5bc50-a6a3-4495-9a38-a5678d543dfd', '2603030d-11a3-4e71-848d-aedd52cc91b2'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:14.051565 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8848d86f-160a-443c-888b-9e31227fca6f tempest-SnapshotsActionsTest-696006644 None] Delete snapshot completed successfully. Nov 06 21:06:14.056540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8848d86f-160a-443c-888b-9e31227fca6f tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-93fe9733-c210-4da6-a255-6f6a336d2e66-delete_snapshot'" released by "delete_snapshot" :: held 1.104s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:14.141479 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Created reservations ['ae95a935-9241-461b-897b-f044f18ddce6', 'dee9cf04-0d02-438b-b55e-bed083215e3f', '5eed517a-8ec1-413d-90dc-59bb060c7e33', '9606deae-ebd9-409f-9919-c64fbcd71b4a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:14.181255 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:14.203244 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:14.224974 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:14.228946 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Deleted volume successfully. Nov 06 21:06:14.240866 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26160320-5e1c-4853-85d3-7ddde0be60df tempest-VolumesBackupsAdminTest-530643389 None] Lock "b'cinder-b42fdfd4-1349-458d-819b-36de88c750f8-delete_volume'" released by "delete_volume" :: held 0.706s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:14.932703 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2a53de26-e193-4184-9513-87461d247168 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:16.037544 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2a53de26-e193-4184-9513-87461d247168 tempest-SnapshotsActionsTest-1152980065 None] Create snapshot completed successfully Nov 06 21:06:17.091691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d9754d50-9e5c-4f40-a102-eb9fde6453f7 tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-84960beb-3d6c-4795-8b0f-9ee21bb2a2fe-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:17.093936 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d9754d50-9e5c-4f40-a102-eb9fde6453f7 tempest-SnapshotsActionsTest-696006644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:18.118476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d9754d50-9e5c-4f40-a102-eb9fde6453f7 tempest-SnapshotsActionsTest-696006644 None] Created reservations ['aa204521-a75d-4b95-85ad-418726c50aa8', '9da5edcd-1b12-44f0-9b6e-61de291ec671', 'cacdc46b-35f2-43f3-bacd-8cbff2665581', '22a7ec0b-4bf5-48b4-8839-21efe922c5b3'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:18.220833 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d9754d50-9e5c-4f40-a102-eb9fde6453f7 tempest-SnapshotsActionsTest-696006644 None] Delete snapshot completed successfully. Nov 06 21:06:18.266284 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d9754d50-9e5c-4f40-a102-eb9fde6453f7 tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-84960beb-3d6c-4795-8b0f-9ee21bb2a2fe-delete_snapshot'" released by "delete_snapshot" :: held 1.175s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:18.613346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:18.616643 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:18.617084 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:18.628913 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (5774d365-1246-410a-88ba-093f796e5bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:18.631912 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dcfca7-17ac-4e78-aefb-d90364b81297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.638817 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:18.650474 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58dcfca7-17ac-4e78-aefb-d90364b81297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-713703287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a1e216d8-3a6b-4fcb-a9c0-a136b001e711,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851c2b80f5494964acaa57e656390e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:19Z,use_quota=True,user_id='ec5fd2a8ee26496aadb9e422dc995fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.652967 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077cbe70-d2ac-4b0a-aa1b-fbb92144c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.655031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077cbe70-d2ac-4b0a-aa1b-fbb92144c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.657364 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69c3754-a659-4224-a5dd-ffc80baa0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.659491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69c3754-a659-4224-a5dd-ffc80baa0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'volume_name': 'volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.661722 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55982fb3-78d3-423a-8999-2f74f7409351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.663744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55982fb3-78d3-423a-8999-2f74f7409351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.665887 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c48086-ad44-47fe-9536-fb7b11c22aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.666638 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Volume a1e216d8-3a6b-4fcb-a9c0-a136b001e711: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'volume_size': 1} Nov 06 21:06:18.667283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] creating volume 'volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:18.668235 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:18.715365 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:18.715820 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:18.717866 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07c48086-ad44-47fe-9536-fb7b11c22aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.719918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2533744e-c724-43ee-8264-c80143aaae01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:18.728378 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Volume volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711 (a1e216d8-3a6b-4fcb-a9c0-a136b001e711): created successfully Nov 06 21:06:18.730120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2533744e-c724-43ee-8264-c80143aaae01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:18.733001 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (5774d365-1246-410a-88ba-093f796e5bf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:18.740054 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-eccc4869-2ff8-4036-9b90-2fe729396542 tempest-VolumesBackupsTest-994108957 None] Created volume successfully. Nov 06 21:06:19.427939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2307438-1aee-4159-a756-4cb7416db42d tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:20.054130 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c2307438-1aee-4159-a756-4cb7416db42d tempest-SnapshotsActionsTest-1152980065 None] Create snapshot completed successfully Nov 06 21:06:20.584464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1ac53387-fa13-40dc-9c63-e0ecb1821502 tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-86311570-30d2-4925-991d-7474a045874b-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:20.589248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1ac53387-fa13-40dc-9c63-e0ecb1821502 tempest-SnapshotsActionsTest-696006644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:21.070298 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-1ac53387-fa13-40dc-9c63-e0ecb1821502 tempest-SnapshotsActionsTest-696006644 None] Created reservations ['99049fba-d310-40e6-847c-f9fcc0fe5763', '5c5f4708-9516-4532-8b85-0f99976eff30', 'd3947be1-3e30-4170-8297-3e57ef3ed8c5', '2e90071f-fcdb-4281-83a5-a8c23efedb7d'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:21.104368 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1ac53387-fa13-40dc-9c63-e0ecb1821502 tempest-SnapshotsActionsTest-696006644 None] Delete snapshot completed successfully. Nov 06 21:06:21.110546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1ac53387-fa13-40dc-9c63-e0ecb1821502 tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-86311570-30d2-4925-991d-7474a045874b-delete_snapshot'" released by "delete_snapshot" :: held 0.526s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:21.896762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbcc54b4-68bd-439b-afac-a023fcb406d0 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:22.935610 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bbcc54b4-68bd-439b-afac-a023fcb406d0 tempest-SnapshotsActionsTest-1152980065 None] Create snapshot completed successfully Nov 06 21:06:24.106836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7dda80a1-a0b0-4583-8d89-583ac50f801c tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-22505e4c-4e23-4e9c-9b7e-884f6fc1a95f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.024s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:24.110574 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7dda80a1-a0b0-4583-8d89-583ac50f801c tempest-SnapshotsActionsTest-696006644 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:24.374921 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-7dda80a1-a0b0-4583-8d89-583ac50f801c tempest-SnapshotsActionsTest-696006644 None] Created reservations ['bb1c77fb-cc65-4936-a619-6923a892e322', 'a016cfad-13ee-42e5-8049-207f486e132c', '84419b32-8135-40c9-be4c-8df6c03965ad', '097539be-b246-48f9-8fe1-a822adaca62a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:24.409138 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7dda80a1-a0b0-4583-8d89-583ac50f801c tempest-SnapshotsActionsTest-696006644 None] Delete snapshot completed successfully. Nov 06 21:06:24.413781 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7dda80a1-a0b0-4583-8d89-583ac50f801c tempest-SnapshotsActionsTest-696006644 None] Lock "b'cinder-22505e4c-4e23-4e9c-9b7e-884f6fc1a95f-delete_snapshot'" released by "delete_snapshot" :: held 0.307s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:25.570547 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7c6e9e75-923c-4d47-b305-34c40954d828 tempest-SnapshotsActionsTest-1152980065 None] Lock "b'cinder-d5a0cd51-51b1-4d3e-8716-fa9fb411ff71-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:25.572241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c6e9e75-923c-4d47-b305-34c40954d828 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:26.390996 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-7c6e9e75-923c-4d47-b305-34c40954d828 tempest-SnapshotsActionsTest-1152980065 None] Created reservations ['090b00e4-6d01-4ed6-9ae5-782bf955686e', '3d41af11-4c31-43cc-8403-a19bd2e5a29f', '58e4ab0d-5620-41f9-9fa8-3ddc15aa2c31', '5acaa426-5467-449a-95af-7caf66f91a75'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:26.426322 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7c6e9e75-923c-4d47-b305-34c40954d828 tempest-SnapshotsActionsTest-1152980065 None] Delete snapshot completed successfully. Nov 06 21:06:26.431640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7c6e9e75-923c-4d47-b305-34c40954d828 tempest-SnapshotsActionsTest-1152980065 None] Lock "b'cinder-d5a0cd51-51b1-4d3e-8716-fa9fb411ff71-delete_snapshot'" released by "delete_snapshot" :: held 0.861s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:26.661511 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Lock "b'cinder-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:26.699035 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:26.734926 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:06:26.735354 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Volume volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:26.739486 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] deleting rbd volume volume-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:26.930317 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Created reservations ['e467d458-a007-4127-bd0f-29ff22c911fa', 'dcd19d8a-44b5-465c-8598-d8432dc79aa5', '68b44240-a06d-4d22-a807-22985e46dbf9', '75da312f-cad4-4a8b-9827-1dbd82d7dc52'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:26.968693 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:26.997027 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:27.023480 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:27.029963 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Deleted volume successfully. Nov 06 21:06:27.042517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-46cbcdd6-1d05-4190-b588-dbbcaf655b10 tempest-SnapshotsActionsTest-1152980065 None] Lock "b'cinder-d06fa1f8-1506-4e82-ba23-b8c0f72b27fa-delete_volume'" released by "delete_volume" :: held 0.381s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:33.861383 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-2b90e796-c36a-4f8f-952a-ffeb999bad10 req-43434a87-405d-455f-9bd6-61be71ea8b3f tempest-VolumesBackupsTest-994108957 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:06:34.537473 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-2b90e796-c36a-4f8f-952a-ffeb999bad10 req-43434a87-405d-455f-9bd6-61be71ea8b3f tempest-VolumesBackupsTest-994108957 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.676s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:06:34.538306 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-2b90e796-c36a-4f8f-952a-ffeb999bad10 req-43434a87-405d-455f-9bd6-61be71ea8b3f tempest-VolumesBackupsTest-994108957 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:06:34.560241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-2b90e796-c36a-4f8f-952a-ffeb999bad10 req-43434a87-405d-455f-9bd6-61be71ea8b3f tempest-VolumesBackupsTest-994108957 None] Connection info returned from driver {'name': 'volumes/volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '87e44d7d-629f-4e3e-a0c6-8e411be4de78'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:06:34.607716 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-2b90e796-c36a-4f8f-952a-ffeb999bad10 req-43434a87-405d-455f-9bd6-61be71ea8b3f tempest-VolumesBackupsTest-994108957 None] attachment_update completed successfully. Nov 06 21:06:37.216284 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:06:37.875922 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.659s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:06:37.877041 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'a1e216d8-3a6b-4fcb-a9c0-a136b001e711', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:06:37.893101 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] Initialize volume connection completed successfully. Nov 06 21:06:39.784390 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] Terminate volume connection completed successfully. Nov 06 21:06:39.804788 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c847e5b1-7456-41d6-a90f-440720cf3299 tempest-VolumesBackupsTest-994108957 None] Remove volume export completed successfully. Nov 06 21:06:42.781826 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da req-01b6a6b8-cf89-427f-a0ff-177690aa7795 tempest-VolumesBackupsTest-994108957 None] Terminate volume connection completed successfully. Nov 06 21:06:42.782531 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-4fc4879c-7cf0-4cfc-b181-b41ac78e70da req-01b6a6b8-cf89-427f-a0ff-177690aa7795 tempest-VolumesBackupsTest-994108957 None] Deleting attachment 87e44d7d-629f-4e3e-a0c6-8e411be4de78. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:06:45.850198 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Lock "b'cinder-9b64a67e-6923-49a0-aee9-6485b5c59a82-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:45.902185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:45.947274 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:06:45.947815 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Volume volume-9b64a67e-6923-49a0-aee9-6485b5c59a82 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:45.956084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] deleting rbd volume volume-9b64a67e-6923-49a0-aee9-6485b5c59a82 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:45.969330 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:45.974634 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:45.975382 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:45.992246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (51d60afe-652a-48b3-8b40-ff1ccc95b88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:45.996761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5db65a-430b-43a0-8e3d-ca3f1f79960a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.004511 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:46.025587 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e5db65a-430b-43a0-8e3d-ca3f1f79960a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-96895847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a2f2e7f7-024b-4a7f-864a-5e6173e969a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:46Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.028540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa033fe-bf4e-4fbb-8543-40b75bca9009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.031165 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa033fe-bf4e-4fbb-8543-40b75bca9009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.034241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5a2305-485b-4db1-bfc2-389609d0ca56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.036616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a5a2305-485b-4db1-bfc2-389609d0ca56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2f2e7f7-024b-4a7f-864a-5e6173e969a4', 'volume_name': 'volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.038852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e87a8-65a9-4354-a203-00fbfca659df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.041155 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e87a8-65a9-4354-a203-00fbfca659df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.043642 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92b8b1a-8999-405f-9353-f5261fd9c9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.044625 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Volume a2f2e7f7-024b-4a7f-864a-5e6173e969a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4', 'volume_size': 1} Nov 06 21:06:46.045081 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] creating volume 'volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:46.046311 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:46.108195 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:46.108643 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:46.110754 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c92b8b1a-8999-405f-9353-f5261fd9c9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.112935 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6412c3f8-0757-4a45-900a-403d7fc377f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:46.122566 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Volume volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4 (a2f2e7f7-024b-4a7f-864a-5e6173e969a4): created successfully Nov 06 21:06:46.124854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6412c3f8-0757-4a45-900a-403d7fc377f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:46.128843 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (51d60afe-652a-48b3-8b40-ff1ccc95b88c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:46.136988 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d8b8d559-e188-44d5-9504-6888a990d228 tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:06:46.246559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Created reservations ['b717c14a-d713-422d-af2c-637e10699660', '5fbfeb42-e3e6-4682-b2c0-3f3d60b77d00', '6cf86192-dfc7-4f65-98b5-136856b25ecc', '7364b03e-8247-412d-82d3-e1a5a7207ee5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:46.289354 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:46.316327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:46.344125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:46.349211 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Deleted volume successfully. Nov 06 21:06:46.361157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-3f38bd2f-8f73-43d4-8530-fd58708deffe tempest-AttachVolumeShelveTestJSON-860784193 None] Lock "b'cinder-9b64a67e-6923-49a0-aee9-6485b5c59a82-delete_volume'" released by "delete_volume" :: held 0.511s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:47.001234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9eef1425-bdb5-4012-a1e5-b2fb76d6547c tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4'" acquired by "attach_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:47.064853 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9eef1425-bdb5-4012-a1e5-b2fb76d6547c tempest-VolumesActionsTest-961164403 None] Attaching volume a2f2e7f7-024b-4a7f-864a-5e6173e969a4 to instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0 at mountpoint /dev/sdb on host None. Nov 06 21:06:47.115701 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9eef1425-bdb5-4012-a1e5-b2fb76d6547c tempest-VolumesActionsTest-961164403 None] Attach volume completed successfully. Nov 06 21:06:47.122613 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9eef1425-bdb5-4012-a1e5-b2fb76d6547c tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4'" released by "attach_volume" :: held 0.122s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:47.169779 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Lock "b'cinder-009aa4f5-f40b-4281-b200-5544181221dc-delete_volume'" acquired by "delete_volume" :: waited 0.042s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:47.246063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:47.305663 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:06:47.306351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Volume volume-009aa4f5-f40b-4281-b200-5544181221dc is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:47.322710 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] deleting rbd volume volume-009aa4f5-f40b-4281-b200-5544181221dc {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:47.595489 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1a8ce0cf-9705-48f7-95ab-62b432b91909 tempest-VolumesActionsTest-1988851200 None] Terminate volume connection completed successfully. Nov 06 21:06:47.642036 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1a8ce0cf-9705-48f7-95ab-62b432b91909 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-detach_volume'" acquired by "detach_volume" :: waited 0.020s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:47.666065 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1a8ce0cf-9705-48f7-95ab-62b432b91909 tempest-VolumesActionsTest-1988851200 None] Detaching volume a2f2e7f7-024b-4a7f-864a-5e6173e969a4 from instance c2a608ec-c9c5-4ddc-ada6-a5c7aa8c7ac0. Nov 06 21:06:47.693639 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Created reservations ['f1c9413b-fe7f-4ca8-a897-258764aba7c0', 'c46d5157-a180-46ba-a238-e7017b01a49d', 'af7a7916-788c-4e10-8930-747feb894b6b', 'f164469d-d270-43c1-8646-a06621a72161'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:47.721953 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1a8ce0cf-9705-48f7-95ab-62b432b91909 tempest-VolumesActionsTest-1988851200 None] Detach volume completed successfully. Nov 06 21:06:47.729615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-1a8ce0cf-9705-48f7-95ab-62b432b91909 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-detach_volume'" released by "detach_volume" :: held 0.088s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:47.752807 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:47.804900 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:47.878755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:47.892713 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Deleted volume successfully. Nov 06 21:06:47.912340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4302ab1f-fe2a-4adf-9d95-2d03306110d4 tempest-AttachVolumeShelveTestJSON-860784193 None] Lock "b'cinder-009aa4f5-f40b-4281-b200-5544181221dc-delete_volume'" released by "delete_volume" :: held 0.742s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:47.937143 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e37b539e-5111-44cd-adb4-429d827eecf4 tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-detach_volume'" acquired by "detach_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:47.937691 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e37b539e-5111-44cd-adb4-429d827eecf4 tempest-VolumesActionsTest-961164403 None] Volume detach called, but volume not attached. Nov 06 21:06:47.950562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e37b539e-5111-44cd-adb4-429d827eecf4 tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-detach_volume'" released by "detach_volume" :: held 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:48.915115 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-a1e216d8-3a6b-4fcb-a9c0-a136b001e711-delete_volume'" acquired by "delete_volume" :: waited 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:48.970860 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:49.735067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Volume volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:49.764590 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] deleting rbd volume volume-a1e216d8-3a6b-4fcb-a9c0-a136b001e711 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:50.085608 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Created reservations ['c0cf73ca-0cd4-4216-99f9-1cb936b7581f', '35f1af76-9b15-4b84-a8d5-468fd86f73e8', 'a1fa72fa-f65d-46db-a68b-dfb5bb5e4dc2', 'd4553953-76ac-498d-917e-3e60846cfc7f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:50.162563 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:50.223204 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:50.269195 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:50.274215 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Deleted volume successfully. Nov 06 21:06:50.299624 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c9fa4b46-83d9-492b-aa76-5b714f67148f tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-a1e216d8-3a6b-4fcb-a9c0-a136b001e711-delete_volume'" released by "delete_volume" :: held 1.381s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:52.065791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:52.072238 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:52.073559 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:52.094794 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (c4b62d53-87fb-40a7-ae99-8dc9f3aa9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:52.100085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99189ca0-0ad3-44d1-b755-a60fcb96bfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:52.113957 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:52.139119 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99189ca0-0ad3-44d1-b755-a60fcb96bfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsTest-Volume-1307485956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d97c184c-739e-4519-89af-db6cea863c7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851c2b80f5494964acaa57e656390e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:52Z,use_quota=True,user_id='ec5fd2a8ee26496aadb9e422dc995fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:52.142492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8778cd-b7a9-4214-a586-f01ab9b56dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:52.146630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e8778cd-b7a9-4214-a586-f01ab9b56dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:52.152082 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199a4a30-ed55-47e6-82e6-a933e79e3968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:52.305292 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199a4a30-ed55-47e6-82e6-a933e79e3968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd97c184c-739e-4519-89af-db6cea863c7f', 'volume_name': 'volume-d97c184c-739e-4519-89af-db6cea863c7f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:52.307620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bd29af-ba18-4b1b-a39c-a81340ad3581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:52.314670 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18bd29af-ba18-4b1b-a39c-a81340ad3581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:52.318192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074255c8-1b35-42bb-9886-b9f794539b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:52.319503 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Volume d97c184c-739e-4519-89af-db6cea863c7f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d97c184c-739e-4519-89af-db6cea863c7f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:06:52.320562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Cloning d97c184c-739e-4519-89af-db6cea863c7f from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:06:52.333435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:52.347340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 6, 52, 338690)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:06:52.348226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:06:52.348860 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:06:52.354981 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:52.356634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:06:52.363286 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 6, 52, 360753)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:06:52.363711 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:06:52.364168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:06:52.377063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:52.503656 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] creating snapshot='volume-d97c184c-739e-4519-89af-db6cea863c7f.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:06:52.919109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-d97c184c-739e-4519-89af-db6cea863c7f.clone_snap' to 'volume-d97c184c-739e-4519-89af-db6cea863c7f' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:06:53.174125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:53.182861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:53.183619 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:53.207698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:06:53.208412 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Marking volume d97c184c-739e-4519-89af-db6cea863c7f as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:06:53.225666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to d97c184c-739e-4519-89af-db6cea863c7f. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:06:53.226130 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Creating volume glance metadata for volume d97c184c-739e-4519-89af-db6cea863c7f backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:06:53.295812 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074255c8-1b35-42bb-9886-b9f794539b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d97c184c-739e-4519-89af-db6cea863c7f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:53.298429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a698b8a-8a83-40a2-a952-16cf76e98d79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:53.311331 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Volume volume-d97c184c-739e-4519-89af-db6cea863c7f (d97c184c-739e-4519-89af-db6cea863c7f): created successfully Nov 06 21:06:53.314818 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a698b8a-8a83-40a2-a952-16cf76e98d79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:53.318459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (c4b62d53-87fb-40a7-ae99-8dc9f3aa9e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:53.333041 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0e5372e4-b442-4f20-85cf-717f07f73ec6 tempest-VolumesBackupsTest-994108957 None] Created volume successfully. Nov 06 21:06:54.289547 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:54.294707 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:54.295450 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:54.308957 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (fe4609a2-66e5-4e5c-b092-8bf314a1448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:54.313679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736a15cc-ae69-48c8-8b1f-7b9cd2453e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.320644 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:54.336038 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (736a15cc-ae69-48c8-8b1f-7b9cd2453e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-748788059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c5bedfb1-b052-431a-9721-fdfeb73ff0b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:54Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.350628 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb48163-7f01-4b9c-82b5-715f53209c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.358196 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cb48163-7f01-4b9c-82b5-715f53209c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.363244 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a2b9f-c081-4f04-9e36-c5e929b5a2d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.369331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75a2b9f-c081-4f04-9e36-c5e929b5a2d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5bedfb1-b052-431a-9721-fdfeb73ff0b7', 'volume_name': 'volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.371726 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ed72b4-eb16-4dfd-a2a1-216bc3f6ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.375839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ed72b4-eb16-4dfd-a2a1-216bc3f6ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.378258 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5874ec3f-37eb-4c2a-b15d-6a00fdb290f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.379380 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Volume c5bedfb1-b052-431a-9721-fdfeb73ff0b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7', 'volume_size': 1} Nov 06 21:06:54.379950 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] creating volume 'volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:54.381157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:54.551316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:54.551737 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:54.555696 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5874ec3f-37eb-4c2a-b15d-6a00fdb290f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.558630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00e9262-9b47-4950-9aee-2822683d1f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:54.573242 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Volume volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7 (c5bedfb1-b052-431a-9721-fdfeb73ff0b7): created successfully Nov 06 21:06:54.575809 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b00e9262-9b47-4950-9aee-2822683d1f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:54.580072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (fe4609a2-66e5-4e5c-b092-8bf314a1448c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:54.600845 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b7314f22-b512-460e-b8a0-250dba65024d tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:06:54.770854 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:06:55.874892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-c5bedfb1-b052-431a-9721-fdfeb73ff0b7-delete_volume'" acquired by "delete_volume" :: waited 0.037s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:55.953053 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.190s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:06:55.955341 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d97c184c-739e-4519-89af-db6cea863c7f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'd97c184c-739e-4519-89af-db6cea863c7f', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:06:55.961377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:56.079314 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:06:56.080564 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Volume volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:56.099178 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] deleting rbd volume volume-c5bedfb1-b052-431a-9721-fdfeb73ff0b7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:06:56.120597 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] Initialize volume connection completed successfully. Nov 06 21:06:56.655461 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Created reservations ['a2a95152-406f-42d0-bec7-4cfe41bb3030', '9656af67-6415-4f91-a01e-77cbb2f2681e', 'ac08fa1d-2177-45b1-a7e5-dd594b0443bf', '658e9492-b819-4933-982c-cb2126a948e4'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:06:56.713741 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:56.787863 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:56.871126 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:06:56.884258 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Deleted volume successfully. Nov 06 21:06:56.910832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fe663a6b-269e-4083-877f-8daa6be37665 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-c5bedfb1-b052-431a-9721-fdfeb73ff0b7-delete_volume'" released by "delete_volume" :: held 1.038s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:06:57.899465 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:06:57.924264 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:06:57.933013 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:06:57.951177 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (cc34f4ea-75ee-40dd-9d98-82ec2d68002f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:57.965265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04028007-9ab1-4726-8f56-dc20914063e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:57.973722 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:06:57.988630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04028007-9ab1-4726-8f56-dc20914063e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1252728781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7f78d692-9e46-4b0d-9c90-6d0b6fc7e662,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:06:58Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:57.991670 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628f2066-a91d-44f5-8f0b-a6e9e2d6cec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:57.994502 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628f2066-a91d-44f5-8f0b-a6e9e2d6cec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:57.998750 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a34b237-46d0-405e-a25f-1661c98265e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:58.002802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a34b237-46d0-405e-a25f-1661c98265e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f78d692-9e46-4b0d-9c90-6d0b6fc7e662', 'volume_name': 'volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:58.006566 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7620d715-2027-4558-93e7-424e14590f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:58.010479 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7620d715-2027-4558-93e7-424e14590f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:58.013707 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca77670c-8d0a-4ee9-8300-36fee139a052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:58.014584 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Volume 7f78d692-9e46-4b0d-9c90-6d0b6fc7e662: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662', 'volume_size': 1} Nov 06 21:06:58.014956 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] creating volume 'volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:06:58.016616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:58.370755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:06:58.371555 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:06:58.374065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca77670c-8d0a-4ee9-8300-36fee139a052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:58.377120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c6e7c8-c3f9-40d3-b7b4-a7eeb0ea33a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:06:58.401874 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Volume volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662 (7f78d692-9e46-4b0d-9c90-6d0b6fc7e662): created successfully Nov 06 21:06:58.404024 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5c6e7c8-c3f9-40d3-b7b4-a7eeb0ea33a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:06:58.407420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (cc34f4ea-75ee-40dd-9d98-82ec2d68002f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:06:58.436327 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0868086f-6981-425b-8301-ed7e0c9e8d8f tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:06:59.248699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662-delete_volume'" acquired by "delete_volume" :: waited 0.031s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:06:59.288031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:06:59.610530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:06:59.611337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Volume volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:06:59.635492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] deleting rbd volume volume-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:02.298165 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Created reservations ['db85e52e-b1f1-45e3-970d-818274a73fb9', '3e5bdf7f-4bc3-449b-b759-7fe62081c03d', 'feb57129-5042-437c-bc66-425e95f6b0eb', '9e1877ae-d5b7-4306-95ad-4c27c8334430'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:02.427387 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:02.499364 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:02.588737 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:02.609925 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Deleted volume successfully. Nov 06 21:07:02.639633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-5738ab28-02a2-47fe-933d-a0be8c4163c4 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-7f78d692-9e46-4b0d-9c90-6d0b6fc7e662-delete_volume'" released by "delete_volume" :: held 3.391s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:03.466168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:03.471629 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:03.472424 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:03.513398 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (23ea4530-ae71-4c39-a0e6-de6a1864de26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:03.524822 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0b7c5-c06a-4469-8543-a563dc259907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:03.545336 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:03.570279 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e0b7c5-c06a-4469-8543-a563dc259907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2032096969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=9523c834-fbf8-4b20-983e-b44ebd21e919,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:03Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:03.591088 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6438b8c-2685-4c0d-b39e-0bf42fcc4ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:03.593524 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6438b8c-2685-4c0d-b39e-0bf42fcc4ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:03.597957 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8097c4c8-cfda-48b3-8685-a8fe344b9f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:03.608434 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8097c4c8-cfda-48b3-8685-a8fe344b9f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9523c834-fbf8-4b20-983e-b44ebd21e919', 'volume_name': 'volume-9523c834-fbf8-4b20-983e-b44ebd21e919', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:03.630247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65a5a2e-d6d0-4643-9395-0bb5e85e18f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:03.662447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65a5a2e-d6d0-4643-9395-0bb5e85e18f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:03.665401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdf28c-1e19-4906-8e55-2446e51d1c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:03.666505 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Volume 9523c834-fbf8-4b20-983e-b44ebd21e919: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9523c834-fbf8-4b20-983e-b44ebd21e919', 'volume_size': 1} Nov 06 21:07:03.667377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] creating volume 'volume-9523c834-fbf8-4b20-983e-b44ebd21e919' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:03.668613 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:04.167020 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:04.167625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:04.169537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccdf28c-1e19-4906-8e55-2446e51d1c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9523c834-fbf8-4b20-983e-b44ebd21e919', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:04.173495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303f0b9f-9f86-45d2-93d5-4a948a567bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:04.200443 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Volume volume-9523c834-fbf8-4b20-983e-b44ebd21e919 (9523c834-fbf8-4b20-983e-b44ebd21e919): created successfully Nov 06 21:07:04.202719 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (303f0b9f-9f86-45d2-93d5-4a948a567bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:04.225187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (23ea4530-ae71-4c39-a0e6-de6a1864de26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:04.298433 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-15780d34-a23b-4058-838d-0e30aa0642c8 tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:07:04.847510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-9523c834-fbf8-4b20-983e-b44ebd21e919-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:04.913049 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:05.076227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:05.076643 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Volume volume-9523c834-fbf8-4b20-983e-b44ebd21e919 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:05.135032 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] deleting rbd volume volume-9523c834-fbf8-4b20-983e-b44ebd21e919 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:06.184065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Created reservations ['ac69983b-d37f-4067-9ed1-1e210be3803c', '2de24a33-3242-4b3b-8832-67256caeba60', '629d5df3-5cce-4175-a3b4-f3e318c9a411', '96a8720a-b67d-4309-bc7b-57e4d494d603'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:06.303585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:06.368615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:06.431451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:06.464042 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Deleted volume successfully. Nov 06 21:07:06.483105 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4bcc8809-a054-49d8-b70f-ccc57ecff7b0 tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-9523c834-fbf8-4b20-983e-b44ebd21e919-delete_volume'" released by "delete_volume" :: held 1.635s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:06.867205 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] Terminate volume connection completed successfully. Nov 06 21:07:06.901635 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5627d29a-36ff-4bc0-8a35-266db59eabd5 tempest-VolumesBackupsTest-994108957 None] Remove volume export completed successfully. Nov 06 21:07:07.615324 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:07.626282 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:07.628702 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:07.662154 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (c2ae3203-34ab-421d-88ff-5ecd7c5e8a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:07.669503 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3351e0-d36c-45f7-9fee-51d0d02d6086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.680824 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:07.700127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f3351e0-d36c-45f7-9fee-51d0d02d6086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-527675324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4bee68fd-a58b-43a8-b2b4-19058172f5e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:08Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:07.704046 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d13f000-7275-4a0a-b791-b9c7cb58466a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.707322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d13f000-7275-4a0a-b791-b9c7cb58466a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:07.712099 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0ffd07-c82d-4882-8502-e516559e2e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.716069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf0ffd07-c82d-4882-8502-e516559e2e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bee68fd-a58b-43a8-b2b4-19058172f5e1', 'volume_name': 'volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:07.721792 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57510f82-b341-4309-95bc-ab6c115c9f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.725437 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57510f82-b341-4309-95bc-ab6c115c9f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:07.729154 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e2386-b4e8-4827-9ef1-1f765906d56d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.730495 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Volume 4bee68fd-a58b-43a8-b2b4-19058172f5e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1', 'volume_size': 1} Nov 06 21:07:07.731609 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] creating volume 'volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:07.733227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:07.959958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:07.961645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:07.964138 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e2386-b4e8-4827-9ef1-1f765906d56d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:07.967061 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f731b3a-4efc-4af6-8ef5-f5d7ab6a80e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:07.994889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:08.001235 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:08.002483 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:08.022155 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (0cd1bf13-7bd6-43ea-ab5b-544ceaacfd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:08.029121 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26b401-7136-4cc6-bb51-e5037e099699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.035476 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Volume volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1 (4bee68fd-a58b-43a8-b2b4-19058172f5e1): created successfully Nov 06 21:07:08.038022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f731b3a-4efc-4af6-8ef5-f5d7ab6a80e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.044755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (c2ae3203-34ab-421d-88ff-5ecd7c5e8a6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:08.052858 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:08.077466 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d26b401-7136-4cc6-bb51-e5037e099699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:08Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_6e0d8ef6-b58b-4407-be3f-0eb2c6006594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d533a7a6-a637-4338-98d6-2b3ebad2d411,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='851c2b80f5494964acaa57e656390e5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:08Z,use_quota=True,user_id='ec5fd2a8ee26496aadb9e422dc995fe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.082858 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5225943-2240-41a5-a267-46ea073f70cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.086053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5225943-2240-41a5-a267-46ea073f70cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.090756 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b6297b-988f-4b74-937d-4ed523b5fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.096687 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33b6297b-988f-4b74-937d-4ed523b5fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd533a7a6-a637-4338-98d6-2b3ebad2d411', 'volume_name': 'volume-d533a7a6-a637-4338-98d6-2b3ebad2d411', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.100826 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20b9936-5ede-468a-9e34-84f96a7d82bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.103774 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20b9936-5ede-468a-9e34-84f96a7d82bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.107133 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a133f0-7b01-4675-97c6-313b097bcd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.110794 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Volume d533a7a6-a637-4338-98d6-2b3ebad2d411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d533a7a6-a637-4338-98d6-2b3ebad2d411', 'volume_size': 1} Nov 06 21:07:08.111339 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] creating volume 'volume-d533a7a6-a637-4338-98d6-2b3ebad2d411' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:08.112746 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:08.215616 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-21393416-1e72-4373-9f5a-bd6dc78cb133 tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:07:08.301901 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:08.302326 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:08.313881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94a133f0-7b01-4675-97c6-313b097bcd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d533a7a6-a637-4338-98d6-2b3ebad2d411', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.313881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1eec5d-6025-4bc6-a135-1588fe3b870d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:08.335463 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Volume volume-d533a7a6-a637-4338-98d6-2b3ebad2d411 (d533a7a6-a637-4338-98d6-2b3ebad2d411): created successfully Nov 06 21:07:08.342336 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1eec5d-6025-4bc6-a135-1588fe3b870d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:08.347657 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Flow 'volume_create_manager' (0cd1bf13-7bd6-43ea-ab5b-544ceaacfd6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:08.376119 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Created volume successfully. Nov 06 21:07:08.760643 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-4bee68fd-a58b-43a8-b2b4-19058172f5e1-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:08.800259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:08.917588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:08.918116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Volume volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:08.934630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] deleting rbd volume volume-4bee68fd-a58b-43a8-b2b4-19058172f5e1 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:09.100477 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:07:09.516052 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Created reservations ['eb66df05-ffcc-45b7-a8b2-24388d7aef68', '3ebec3ec-cd88-4b3e-be68-687eb5d6c68b', '8636e1b1-8f14-4c0c-a5b7-7d6f6e79ba51', '046c522f-ac89-4e0e-8837-5ea03b9071d2'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:09.603568 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:09.714394 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:09.778878 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:09.787099 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Deleted volume successfully. Nov 06 21:07:09.804692 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0a22ed85-8a91-4eb4-b562-5e5b9afd45bf tempest-VolumesActionsTest-1988851200 None] Lock "b'cinder-4bee68fd-a58b-43a8-b2b4-19058172f5e1-delete_volume'" released by "delete_volume" :: held 1.044s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:10.097769 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:07:10.098522 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:10.159881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:10.258842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:10.345758 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.245s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:07:10.346513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d533a7a6-a637-4338-98d6-2b3ebad2d411', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'd533a7a6-a637-4338-98d6-2b3ebad2d411', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:07:10.367694 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Initialize volume connection completed successfully. Nov 06 21:07:10.779970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:10.801060 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:10.802375 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:10.847960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (e6a742b4-f7ca-4371-be2e-47d69b5a56e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:10.853676 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19066ad8-1ee7-40ce-8211-e5ed9abdc9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:10.891311 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:10.931166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19066ad8-1ee7-40ce-8211-e5ed9abdc9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-598558326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=195f6a89-f55d-4ea5-becd-c8434cc44324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf82afb0b851411fa5ebbb7a77e087f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:11Z,use_quota=True,user_id='d3c2cde31b11407793be22fcefdb72a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:10.942865 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0351531-30d9-4776-a359-bb804d5af8bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:10.953393 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0351531-30d9-4776-a359-bb804d5af8bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:10.967785 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7a1343-a3a3-49d3-acf0-39f4054e5ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:10.978374 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e7a1343-a3a3-49d3-acf0-39f4054e5ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '195f6a89-f55d-4ea5-becd-c8434cc44324', 'volume_name': 'volume-195f6a89-f55d-4ea5-becd-c8434cc44324', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:10.987770 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b74d4-607b-4eae-a666-740ea89a6331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:10.991104 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8b74d4-607b-4eae-a666-740ea89a6331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:11.004459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27ecb52-c02b-4b9f-aab3-a419b26edfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:11.006131 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Volume 195f6a89-f55d-4ea5-becd-c8434cc44324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-195f6a89-f55d-4ea5-becd-c8434cc44324', 'volume_size': 1} Nov 06 21:07:11.008905 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] creating volume 'volume-195f6a89-f55d-4ea5-becd-c8434cc44324' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:11.014185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:11.226715 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:11.227423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:11.229909 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a27ecb52-c02b-4b9f-aab3-a419b26edfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-195f6a89-f55d-4ea5-becd-c8434cc44324', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:11.233215 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d460b6-da60-47d4-8a9c-dbc7dd7f6088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:11.260578 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Volume volume-195f6a89-f55d-4ea5-becd-c8434cc44324 (195f6a89-f55d-4ea5-becd-c8434cc44324): created successfully Nov 06 21:07:11.262620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d460b6-da60-47d4-8a9c-dbc7dd7f6088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:11.266615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Flow 'volume_create_manager' (e6a742b4-f7ca-4371-be2e-47d69b5a56e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:11.292851 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-3997f291-31df-4f99-a809-44ed52164aa8 tempest-VolumesActionsTest-961164403 None] Created volume successfully. Nov 06 21:07:12.754807 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-195f6a89-f55d-4ea5-becd-c8434cc44324-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:12.842712 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:13.063447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:13.064014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Volume volume-195f6a89-f55d-4ea5-becd-c8434cc44324 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:13.109521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] deleting rbd volume volume-195f6a89-f55d-4ea5-becd-c8434cc44324 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:14.590146 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Created reservations ['d6861359-ed7a-4c04-b2a6-94c2bff45113', 'accf1904-5f8b-4478-9fe8-5840fa05ad5f', '3ef7b581-c487-49cb-a56b-692d8a3986b2', 'fad493b0-1f8d-4f96-b01e-0f6085ede7fe'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:14.648372 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:14.724636 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:14.811206 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:14.825738 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Deleted volume successfully. Nov 06 21:07:14.847243 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-93712c44-332f-4b92-8a7d-c749ba4be474 tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-195f6a89-f55d-4ea5-becd-c8434cc44324-delete_volume'" released by "delete_volume" :: held 2.092s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:15.439587 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-delete_volume'" acquired by "delete_volume" :: waited 0.043s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:15.544488 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:15.678087 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:15.678087 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Volume volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:15.711741 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] deleting rbd volume volume-a2f2e7f7-024b-4a7f-864a-5e6173e969a4 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:16.607582 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Created reservations ['fd0a0941-b515-4d1e-bd3e-e7ab64807269', 'e36cb8f7-a740-46a8-abbd-f4c4571ecd68', 'd4a0d601-0dfd-490d-869e-3a02b87c6eeb', '286bdfdf-da76-4c78-a46e-59db50374fe9'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:16.679493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:16.724828 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:16.777834 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:16.784952 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Deleted volume successfully. Nov 06 21:07:16.810258 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2ec8d421-9701-48fa-9c27-a1d5c0ce47ad tempest-VolumesActionsTest-961164403 None] Lock "b'cinder-a2f2e7f7-024b-4a7f-864a-5e6173e969a4-delete_volume'" released by "delete_volume" :: held 1.370s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:17.325180 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Terminate volume connection completed successfully. Nov 06 21:07:17.347267 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a44f39ea-122a-4508-9ada-ae072802fd28 tempest-VolumesBackupsTest-994108957 None] Remove volume export completed successfully. Nov 06 21:07:18.601406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-d533a7a6-a637-4338-98d6-2b3ebad2d411-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:18.666008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:19.762285 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Volume volume-d533a7a6-a637-4338-98d6-2b3ebad2d411 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:19.812168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] deleting rbd volume volume-d533a7a6-a637-4338-98d6-2b3ebad2d411 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:20.706144 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Created reservations ['c066aa2d-6659-45df-94cc-04c00acc37fd', '1cd193d0-d47b-4023-ba2e-334247610786', 'ff933c5f-3dd6-43a5-8de3-1f8264fc9a3e', '88ba4078-329f-4de9-b566-12d353f613b7'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:20.795962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:20.875662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:21.008085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:21.012882 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Deleted volume successfully. Nov 06 21:07:21.035191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0c31a2fc-2a67-4329-9b7e-e4c28d5dbfc8 tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-d533a7a6-a637-4338-98d6-2b3ebad2d411-delete_volume'" released by "delete_volume" :: held 2.434s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:24.350805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-d97c184c-739e-4519-89af-db6cea863c7f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:24.419525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:25.721529 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] deleting rbd volume volume-d97c184c-739e-4519-89af-db6cea863c7f {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:25.789538 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:25.796999 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:25.798332 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:25.895063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Flow 'volume_create_manager' (9e932686-75e0-41fb-a625-c2fa93acaf21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:25.912498 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa626b6d-b1a0-4c67-865c-366d88786c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:25.931008 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:25.973598 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa626b6d-b1a0-4c67-865c-366d88786c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-838959005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=119d302a-0f0d-4a13-b3d7-42a816566340,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc746954b8ce430a8a9b26460f7b0b30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:25Z,use_quota=True,user_id='0dc190bc20914814a01c5de065b9666b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:25.989939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3586312-e2ce-461b-86eb-926cbc2b1a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:25.996557 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3586312-e2ce-461b-86eb-926cbc2b1a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:25.999645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fc79dd-7971-4cbf-81a1-b09b148c55aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:26.182028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fc79dd-7971-4cbf-81a1-b09b148c55aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '119d302a-0f0d-4a13-b3d7-42a816566340', 'volume_name': 'volume-119d302a-0f0d-4a13-b3d7-42a816566340', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:26.184423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ae7fc-bbf9-4ecc-9601-cc737876b335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:26.188261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23ae7fc-bbf9-4ecc-9601-cc737876b335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:26.190447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498e44c-4c20-4e5d-b54a-4bd52d89d68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:26.195840 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Volume 119d302a-0f0d-4a13-b3d7-42a816566340: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-119d302a-0f0d-4a13-b3d7-42a816566340', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:07:26.203642 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Cloning 119d302a-0f0d-4a13-b3d7-42a816566340 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:07:26.229518 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.025s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:26.244275 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 7, 26, 237192)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:07:26.245435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:07:26.245825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:07:26.259024 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.028s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:26.259982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:07:26.272852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 7, 26, 267548)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:07:26.276722 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:07:26.277366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:07:26.302582 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:07:26.352862 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] deleting parent snapshot volume-d97c184c-739e-4519-89af-db6cea863c7f.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:07:26.821915 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:26.987120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] creating snapshot='volume-119d302a-0f0d-4a13-b3d7-42a816566340.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:07:28.065612 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-119d302a-0f0d-4a13-b3d7-42a816566340.clone_snap' to 'volume-119d302a-0f0d-4a13-b3d7-42a816566340' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:07:28.168320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] Created reservations ['40cdcec1-0f0d-4145-968a-56334fe9e452', '24b0c0a2-6eb4-4491-bfc3-b03b8d5ab57e', '3ffa7c0c-e457-4edf-84e2-907e9aa5c7ef', '630a6d3f-68ab-45ab-8f6c-d7e9951d3384'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:28.350015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:28.363551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:28.364188 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:28.419058 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:07:28.420252 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Marking volume 119d302a-0f0d-4a13-b3d7-42a816566340 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:07:28.450686 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 119d302a-0f0d-4a13-b3d7-42a816566340. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:07:28.451542 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Creating volume glance metadata for volume 119d302a-0f0d-4a13-b3d7-42a816566340 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:07:28.513972 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:28.574677 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:28.631742 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:28.668069 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] Deleted volume successfully. Nov 06 21:07:28.681657 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498e44c-4c20-4e5d-b54a-4bd52d89d68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-119d302a-0f0d-4a13-b3d7-42a816566340', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:28.685018 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b66239c-cd74-4198-af1a-4e5af57524d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:28.699139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c3691f28-aa6b-47e9-bbf5-27668f9e33cc tempest-VolumesBackupsTest-994108957 None] Lock "b'cinder-d97c184c-739e-4519-89af-db6cea863c7f-delete_volume'" released by "delete_volume" :: held 4.348s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:28.704981 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Volume volume-119d302a-0f0d-4a13-b3d7-42a816566340 (119d302a-0f0d-4a13-b3d7-42a816566340): created successfully Nov 06 21:07:28.720860 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b66239c-cd74-4198-af1a-4e5af57524d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:28.739627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Flow 'volume_create_manager' (9e932686-75e0-41fb-a625-c2fa93acaf21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:28.753830 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4b30f98a-8b78-4462-a0ea-b25dea2f718d tempest-VolumesImageMetadata-1628003119 None] Created volume successfully. Nov 06 21:07:29.397890 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] Lock "b'cinder-119d302a-0f0d-4a13-b3d7-42a816566340-delete_volume'" acquired by "delete_volume" :: waited 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:29.488941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:29.597276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:29.606350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] deleting rbd volume volume-119d302a-0f0d-4a13-b3d7-42a816566340 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:30.071848 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:07:30.117899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] deleting parent snapshot volume-119d302a-0f0d-4a13-b3d7-42a816566340.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:07:30.411748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] Created reservations ['0f4c0a49-a1eb-4acf-b122-49ef51cc0071', 'e85508bd-e377-4315-bc28-ee084c524df1', '8d433ed3-00bb-4200-9556-f876e59fdec7', '147ef308-884b-47b5-b984-4aef622de15d'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:30.491354 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:30.548710 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:30.592029 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:30.596788 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] Deleted volume successfully. Nov 06 21:07:30.615511 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-781ccbf2-240d-4f65-8931-d8f68639f6a3 tempest-VolumesImageMetadata-1628003119 None] Lock "b'cinder-119d302a-0f0d-4a13-b3d7-42a816566340-delete_volume'" released by "delete_volume" :: held 1.217s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:33.034473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:33.052277 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:33.054932 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:33.118527 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (f027c19f-f85d-4adf-81a2-f9fb2a62da52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:33.132059 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03d951f-0fe9-46a0-852c-06f6412e3bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:33.154390 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:33.192396 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c03d951f-0fe9-46a0-852c-06f6412e3bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2079126275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e183a24a-92f4-4dfb-889f-619e91dbbdb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3d016cc9482cbe84da7600719ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:33Z,use_quota=True,user_id='774e5eda51794292b4a51a2a4c944751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:33.205426 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a74c25-846f-4c87-ac66-53d3e2b9e550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:33.211587 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8a74c25-846f-4c87-ac66-53d3e2b9e550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:33.220596 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe30e95-dff2-4843-bf7f-d9f58e90e65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:33.378942 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afe30e95-dff2-4843-bf7f-d9f58e90e65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'volume_name': 'volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:33.381313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a217d26-3b85-4afd-86d0-401a5f8c746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:33.391280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a217d26-3b85-4afd-86d0-401a5f8c746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:33.393892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df21e85f-95c9-44a8-b3d4-23220236cfb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:33.395603 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Volume e183a24a-92f4-4dfb-889f-619e91dbbdb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:07:33.397191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Cloning e183a24a-92f4-4dfb-889f-619e91dbbdb9 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:07:33.435137 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.030s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:33.463265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 7, 33, 449805)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:07:33.463917 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:07:33.464340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:07:33.475048 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.045s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:33.479702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:07:33.493291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 7, 33, 487461)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:07:33.494687 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:07:33.495886 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:07:33.537981 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:33.653712 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] creating snapshot='volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:07:34.103557 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9.clone_snap' to 'volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:07:34.342388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:34.359156 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:34.359805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:34.412278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:07:34.414671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Marking volume e183a24a-92f4-4dfb-889f-619e91dbbdb9 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:07:34.440786 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to e183a24a-92f4-4dfb-889f-619e91dbbdb9. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:07:34.441255 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Creating volume glance metadata for volume e183a24a-92f4-4dfb-889f-619e91dbbdb9 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:07:34.540703 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df21e85f-95c9-44a8-b3d4-23220236cfb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:34.543966 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b71d88f-45bb-47bf-ac4d-b6b88c81a713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:34.561031 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Volume volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9 (e183a24a-92f4-4dfb-889f-619e91dbbdb9): created successfully Nov 06 21:07:34.575872 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b71d88f-45bb-47bf-ac4d-b6b88c81a713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:34.583722 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (f027c19f-f85d-4adf-81a2-f9fb2a62da52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:34.599139 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0888b6f6-ec8f-497f-844d-0b6389ca5f16 tempest-VolumesCloneTest-2126036681 None] Created volume successfully. Nov 06 21:07:35.033071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:35.042379 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:35.043399 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:35.078530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Flow 'volume_create_manager' (c71f8ab6-6405-4e50-847b-db1752ab6608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:35.094740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e813586-4030-47d4-83c8-919f16a72c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.116767 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:35.142901 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e813586-4030-47d4-83c8-919f16a72c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1190658089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=de8093bc-ab07-44c6-8105-caac88e81bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610406eedc61449fa5275734bb4b366f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:35Z,use_quota=True,user_id='675d1064adc447c49890f5f8978c51c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.150864 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b68f87-84ae-4dc2-8851-07108756d5c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.156413 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96b68f87-84ae-4dc2-8851-07108756d5c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.162038 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0b6481-be39-4dbe-899d-a09a0fdf0e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.173761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb0b6481-be39-4dbe-899d-a09a0fdf0e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de8093bc-ab07-44c6-8105-caac88e81bf9', 'volume_name': 'volume-de8093bc-ab07-44c6-8105-caac88e81bf9', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.179633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61ade28-fd45-4139-bdc9-c1a6abac4167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.185343 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61ade28-fd45-4139-bdc9-c1a6abac4167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.192353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650c8289-4376-402d-b074-c9edf8971a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.194259 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Volume de8093bc-ab07-44c6-8105-caac88e81bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de8093bc-ab07-44c6-8105-caac88e81bf9', 'volume_size': 1} Nov 06 21:07:35.195248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] creating volume 'volume-de8093bc-ab07-44c6-8105-caac88e81bf9' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:35.197214 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:35.360798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:35.361234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:35.365031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (650c8289-4376-402d-b074-c9edf8971a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de8093bc-ab07-44c6-8105-caac88e81bf9', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.368456 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058a97ce-9a2d-43ba-91ed-aeddd77a67ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.389488 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Volume volume-de8093bc-ab07-44c6-8105-caac88e81bf9 (de8093bc-ab07-44c6-8105-caac88e81bf9): created successfully Nov 06 21:07:35.391851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058a97ce-9a2d-43ba-91ed-aeddd77a67ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.402574 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Flow 'volume_create_manager' (c71f8ab6-6405-4e50-847b-db1752ab6608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:35.414939 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-701afcf9-89de-4d42-bcff-5cbf0e0b8d2d tempest-VolumesMetadataTest-1105591906 None] Created volume successfully. Nov 06 21:07:35.821219 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:35.825362 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:35.825993 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:35.855078 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (3d6bb8f8-8f38-49bb-9c9e-34ee3eb51615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:35.859492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e1f4aa-2266-419c-9ad9-9a58655a51f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.866413 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:35.879256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35e1f4aa-2266-419c-9ad9-9a58655a51f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-699347369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=2dad8578-ac6c-4463-8357-1e91eb1479ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3d016cc9482cbe84da7600719ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e183a24a-92f4-4dfb-889f-619e91dbbdb9,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:36Z,use_quota=True,user_id='774e5eda51794292b4a51a2a4c944751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.883469 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5787da03-2507-4f4e-ba50-c87bfd0cf621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.885672 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5787da03-2507-4f4e-ba50-c87bfd0cf621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.888385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2de4d41-5863-4bc1-a25e-bcf87399dbe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.907115 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2de4d41-5863-4bc1-a25e-bcf87399dbe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '2dad8578-ac6c-4463-8357-1e91eb1479ea', 'volume_name': 'volume-2dad8578-ac6c-4463-8357-1e91eb1479ea', 'volume_size': 1, 'source_volid': 'e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.909740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f218e8b5-91af-4f38-a732-77576adc6884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.912096 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f218e8b5-91af-4f38-a732-77576adc6884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:35.914700 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d34214b-1a2c-4bb3-977b-a111db00a0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:35.915705 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Volume 2dad8578-ac6c-4463-8357-1e91eb1479ea: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-2dad8578-ac6c-4463-8357-1e91eb1479ea', 'volume_size': 1, 'source_volid': 'e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'source_volstatus': 'available'} Nov 06 21:07:35.929892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:36.062028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] creating snapshot='volume-2dad8578-ac6c-4463-8357-1e91eb1479ea.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:07:36.223499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] cloning 'volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9@volume-2dad8578-ac6c-4463-8357-1e91eb1479ea.clone_snap' to 'volume-2dad8578-ac6c-4463-8357-1e91eb1479ea' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:07:36.628716 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:36.639925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:36.640537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:36.683762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:07:36.684346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Marking volume 2dad8578-ac6c-4463-8357-1e91eb1479ea as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:07:36.701482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Copying metadata from source volume e183a24a-92f4-4dfb-889f-619e91dbbdb9 to 2dad8578-ac6c-4463-8357-1e91eb1479ea. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:432}} Nov 06 21:07:36.765106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d34214b-1a2c-4bb3-977b-a111db00a0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dad8578-ac6c-4463-8357-1e91eb1479ea', 'volume_size': 1, 'source_volid': 'e183a24a-92f4-4dfb-889f-619e91dbbdb9', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:36.767766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a5b3e3-50a7-4358-9a04-298c30428dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:36.778806 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Volume volume-2dad8578-ac6c-4463-8357-1e91eb1479ea (2dad8578-ac6c-4463-8357-1e91eb1479ea): created successfully Nov 06 21:07:36.785894 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a5b3e3-50a7-4358-9a04-298c30428dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:36.796471 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (3d6bb8f8-8f38-49bb-9c9e-34ee3eb51615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:36.813893 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1d43f61e-42b2-4a50-acd4-36b2f3a671ba tempest-VolumesCloneTest-2126036681 None] Created volume successfully. Nov 06 21:07:37.133241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Lock "b'cinder-de8093bc-ab07-44c6-8105-caac88e81bf9-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:37.185684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:37.253299 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:37.253998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Volume volume-de8093bc-ab07-44c6-8105-caac88e81bf9 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:37.266606 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] deleting rbd volume volume-de8093bc-ab07-44c6-8105-caac88e81bf9 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:37.631854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Created reservations ['bda00eba-81fd-4144-968a-7c9d1b228ce0', '70a200f5-4cc1-4755-a5e7-7fcc5931af75', 'c1590b6d-5c51-436b-b62b-3ed23dd50d81', '2bdfdb25-b2ea-40fb-b5bb-d38561ed4011'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:37.701802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:37.761803 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:37.813069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:37.819091 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Deleted volume successfully. Nov 06 21:07:37.837958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-16abc2da-bd85-47ef-89a6-717407882652 tempest-VolumesMetadataTest-1105591906 None] Lock "b'cinder-de8093bc-ab07-44c6-8105-caac88e81bf9-delete_volume'" released by "delete_volume" :: held 0.704s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:38.506121 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:38.518206 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:38.518863 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:38.544814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (1c52b5a4-b4c9-4091-a24d-6232ba6e0629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:38.549795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be70cd82-4298-43f7-984b-b767b9421bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.556931 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:38.572979 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be70cd82-4298-43f7-984b-b767b9421bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1487670587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=291604f6-fd76-476d-97f4-38e2aaca6a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3d016cc9482cbe84da7600719ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:38Z,use_quota=True,user_id='774e5eda51794292b4a51a2a4c944751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.576509 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025c722b-6d61-4aae-8251-ccfafeef6c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.579821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (025c722b-6d61-4aae-8251-ccfafeef6c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.582812 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f50c78e-01ae-4712-9be1-19db607fe05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.585245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f50c78e-01ae-4712-9be1-19db607fe05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '291604f6-fd76-476d-97f4-38e2aaca6a7b', 'volume_name': 'volume-291604f6-fd76-476d-97f4-38e2aaca6a7b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.587986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef6fd21-c835-4d2c-a284-b711eefe5d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.590262 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cef6fd21-c835-4d2c-a284-b711eefe5d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.593477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a92206d-86ac-4c05-8ea6-5f33a9ed58d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.594411 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Volume 291604f6-fd76-476d-97f4-38e2aaca6a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-291604f6-fd76-476d-97f4-38e2aaca6a7b', 'volume_size': 1} Nov 06 21:07:38.594951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] creating volume 'volume-291604f6-fd76-476d-97f4-38e2aaca6a7b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:38.596093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:38.720588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:38.721128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:38.723243 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a92206d-86ac-4c05-8ea6-5f33a9ed58d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-291604f6-fd76-476d-97f4-38e2aaca6a7b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.738067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757dbcf2-970a-4eb0-ac32-f62fd6373d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:38.759696 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Volume volume-291604f6-fd76-476d-97f4-38e2aaca6a7b (291604f6-fd76-476d-97f4-38e2aaca6a7b): created successfully Nov 06 21:07:38.761683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757dbcf2-970a-4eb0-ac32-f62fd6373d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:38.765597 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (1c52b5a4-b4c9-4091-a24d-6232ba6e0629) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:38.781473 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a8355a3e-9c1d-4e5e-80e5-050234c3e8f8 tempest-VolumesCloneTest-2126036681 None] Created volume successfully. Nov 06 21:07:40.068080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:40.077099 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:40.080040 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:40.152458 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (0a220734-5232-4bbc-877d-5765214b8f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:40.161976 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4ba109-580b-4a6b-a18a-acb5ef62c221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:40.175952 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:40.204785 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a4ba109-580b-4a6b-a18a-acb5ef62c221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-880141651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7ea0af4c-8906-4719-9993-eb92128b8d40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fee3d016cc9482cbe84da7600719ad8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=291604f6-fd76-476d-97f4-38e2aaca6a7b,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:40Z,use_quota=True,user_id='774e5eda51794292b4a51a2a4c944751',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:40.209035 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8767a5-2ae3-4ea9-9666-eb20a90aa633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:40.212543 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc8767a5-2ae3-4ea9-9666-eb20a90aa633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:40.215594 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da2c32-9613-4504-a56c-4f7375ac6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:40.255960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74da2c32-9613-4504-a56c-4f7375ac6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '7ea0af4c-8906-4719-9993-eb92128b8d40', 'volume_name': 'volume-7ea0af4c-8906-4719-9993-eb92128b8d40', 'volume_size': 2, 'source_volid': '291604f6-fd76-476d-97f4-38e2aaca6a7b', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:40.258268 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc4adc8-373e-4859-bfb7-6686e3b66a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:40.260630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dc4adc8-373e-4859-bfb7-6686e3b66a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:40.263063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877090aa-6de6-433c-8aa3-de2e69eba845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:40.264005 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Volume 7ea0af4c-8906-4719-9993-eb92128b8d40: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-7ea0af4c-8906-4719-9993-eb92128b8d40', 'volume_size': 2, 'source_volid': '291604f6-fd76-476d-97f4-38e2aaca6a7b', 'source_volstatus': 'available'} Nov 06 21:07:40.286684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:40.397961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] creating snapshot='volume-7ea0af4c-8906-4719-9993-eb92128b8d40.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:07:40.551291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] cloning 'volume-291604f6-fd76-476d-97f4-38e2aaca6a7b@volume-7ea0af4c-8906-4719-9993-eb92128b8d40.clone_snap' to 'volume-7ea0af4c-8906-4719-9993-eb92128b8d40' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:07:40.705749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Volume volume-291604f6-fd76-476d-97f4-38e2aaca6a7b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:40.717567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:40.720385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:40.746515 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] resize volume 'volume-7ea0af4c-8906-4719-9993-eb92128b8d40' from 1 to 2 {{(pid=127482) _extend_if_required /opt/stack/cinder/cinder/volume/drivers/rbd.py:691}} Nov 06 21:07:40.747363 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:40.998530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:07:40.998530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (877090aa-6de6-433c-8aa3-de2e69eba845) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea0af4c-8906-4719-9993-eb92128b8d40', 'volume_size': 2, 'source_volid': '291604f6-fd76-476d-97f4-38e2aaca6a7b', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:41.000279 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9999a23-62f0-40fc-968c-06316d7c7ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:41.019558 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Volume volume-7ea0af4c-8906-4719-9993-eb92128b8d40 (7ea0af4c-8906-4719-9993-eb92128b8d40): created successfully Nov 06 21:07:41.021626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9999a23-62f0-40fc-968c-06316d7c7ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:41.024693 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Flow 'volume_create_manager' (0a220734-5232-4bbc-877d-5765214b8f1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:41.053797 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c2a7b88d-45dd-4476-b8b6-773c8ca5560a tempest-VolumesCloneTest-2126036681 None] Created volume successfully. Nov 06 21:07:42.149314 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:42.156081 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:42.156994 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:42.175137 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Flow 'volume_create_manager' (e46728ff-434a-44a9-a77b-bce9460da23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:42.185514 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79664aec-adcd-4d24-86c3-c82b75cece5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.201217 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:42.228440 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79664aec-adcd-4d24-86c3-c82b75cece5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesBackupsV39Test-Volume-524017712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0c88cbc9-1cec-436f-a0a3-3093c6540c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82c12d403aad4cfab2c66c2157d66580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:42Z,use_quota=True,user_id='a22f57c16b80408d9caccca6e7827a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.231337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d583f9-187d-4c3b-acc2-fced337a56e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.234831 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d583f9-187d-4c3b-acc2-fced337a56e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.237722 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f912b22a-dd45-4cf6-b327-b0cc6ddf606f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.240120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f912b22a-dd45-4cf6-b327-b0cc6ddf606f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'volume_name': 'volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.243779 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d81c1-d95b-4243-a61a-d83051fef4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.246529 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f09d81c1-d95b-4243-a61a-d83051fef4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.249868 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e8e60-d59b-4dad-be19-a17c0b5b323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.250909 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Volume 0c88cbc9-1cec-436f-a0a3-3093c6540c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'volume_size': 1} Nov 06 21:07:42.251439 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] creating volume 'volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:42.253501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:42.341643 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-7ea0af4c-8906-4719-9993-eb92128b8d40-delete_volume'" acquired by "delete_volume" :: waited 0.024s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:42.394159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:42.394747 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:42.397751 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e8e60-d59b-4dad-be19-a17c0b5b323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.401559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f233c97-fb14-483e-9464-d3682e3fed72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:42.428546 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Volume volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96 (0c88cbc9-1cec-436f-a0a3-3093c6540c96): created successfully Nov 06 21:07:42.432084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f233c97-fb14-483e-9464-d3682e3fed72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:42.439805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Flow 'volume_create_manager' (e46728ff-434a-44a9-a77b-bce9460da23c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:42.447600 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:42.534451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:42.547402 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] deleting rbd volume volume-7ea0af4c-8906-4719-9993-eb92128b8d40 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:42.551296 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0f098063-4521-4d8c-a44c-9526cc89c6dd tempest-VolumesBackupsV39Test-1523267356 None] Created volume successfully. Nov 06 21:07:42.949518 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:07:42.983669 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Volume volume-291604f6-fd76-476d-97f4-38e2aaca6a7b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:42.984608 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] deleting parent snapshot volume-7ea0af4c-8906-4719-9993-eb92128b8d40.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:07:44.112782 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:07:44.169821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Created reservations ['f26d27fe-0a5a-4939-8892-5a68399bbd94', '95a3cff7-f4cf-4e7d-a151-8dadbad23f82', 'bf52855f-28d6-4b7c-b0e6-e409b8efffc0', '515796b2-cb77-4196-9bbb-f91813ba1e02'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:44.297712 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:44.367981 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:44.412676 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:44.417387 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Deleted volume successfully. Nov 06 21:07:44.444510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ad4e172c-28a4-4179-8334-e606cd95887b tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-7ea0af4c-8906-4719-9993-eb92128b8d40-delete_volume'" released by "delete_volume" :: held 2.104s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:44.770947 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-291604f6-fd76-476d-97f4-38e2aaca6a7b-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:44.827713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:44.949606 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:44.950194 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Volume volume-291604f6-fd76-476d-97f4-38e2aaca6a7b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:44.966760 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] deleting rbd volume volume-291604f6-fd76-476d-97f4-38e2aaca6a7b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:45.089604 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.977s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:07:45.090484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '0c88cbc9-1cec-436f-a0a3-3093c6540c96', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:07:45.107781 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] Initialize volume connection completed successfully. Nov 06 21:07:45.387609 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Created reservations ['9442e9b7-f955-477b-8efd-fa3b07c9ecda', '666dc4a8-757f-48ed-9bc0-0789f022f4e4', 'd5e351e9-9b32-4cb8-879e-33757114774c', '4797cdf4-9d87-42d0-98f8-78a4a495a7e0'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:45.480476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:45.551821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:45.609651 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:45.614479 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Deleted volume successfully. Nov 06 21:07:45.631590 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-f0f23fba-affd-4827-a39e-9cf8c7218bbd tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-291604f6-fd76-476d-97f4-38e2aaca6a7b-delete_volume'" released by "delete_volume" :: held 0.861s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:45.962884 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-2dad8578-ac6c-4463-8357-1e91eb1479ea-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:46.026369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:46.173311 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:46.184874 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] deleting rbd volume volume-2dad8578-ac6c-4463-8357-1e91eb1479ea {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:46.509065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:46.518558 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:46.518558 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:46.535969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Flow 'volume_create_manager' (8311070b-db81-4cfd-9af1-1456bdb530fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:46.540703 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95262316-850a-4ddb-8584-18da0b49fefa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:46.548249 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:46.562990 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95262316-850a-4ddb-8584-18da0b49fefa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-977191326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5b264d32-7085-4e51-90c3-0767a5710a13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='930a318a21a4455c8d2c6eb794459b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:46Z,use_quota=True,user_id='4ef3f8eee14643889cf3f3ccf5858c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:46.565724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9839ed6-0c3c-476a-ae97-7ef00818fa84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:46.568322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9839ed6-0c3c-476a-ae97-7ef00818fa84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:46.571415 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0bb155-86e5-4718-8204-f94ad26b29cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:46.573922 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee0bb155-86e5-4718-8204-f94ad26b29cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b264d32-7085-4e51-90c3-0767a5710a13', 'volume_name': 'volume-5b264d32-7085-4e51-90c3-0767a5710a13', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:46.576255 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8728ea95-6af3-4675-a24a-695f51b78492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:46.579093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8728ea95-6af3-4675-a24a-695f51b78492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:46.581539 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c739e7f-6ba6-4170-9117-83f5843d1b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:46.582387 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Volume 5b264d32-7085-4e51-90c3-0767a5710a13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b264d32-7085-4e51-90c3-0767a5710a13', 'volume_size': 1} Nov 06 21:07:46.582850 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] creating volume 'volume-5b264d32-7085-4e51-90c3-0767a5710a13' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:46.584267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:46.608178 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:07:46.663359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] deleting parent snapshot volume-2dad8578-ac6c-4463-8357-1e91eb1479ea.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:07:47.142560 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:47.143183 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:47.145441 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c739e7f-6ba6-4170-9117-83f5843d1b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b264d32-7085-4e51-90c3-0767a5710a13', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:47.164705 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a11729-5872-4647-a80d-03251522c63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:47.201438 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Volume volume-5b264d32-7085-4e51-90c3-0767a5710a13 (5b264d32-7085-4e51-90c3-0767a5710a13): created successfully Nov 06 21:07:47.203033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a11729-5872-4647-a80d-03251522c63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:47.206294 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Flow 'volume_create_manager' (8311070b-db81-4cfd-9af1-1456bdb530fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:47.217967 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1c2f171d-7162-4f59-b33b-373ea17d31e7 tempest-ServersNegativeTestJSON-1908266986 None] Created volume successfully. Nov 06 21:07:47.248870 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] Created reservations ['46b2cd96-2789-4ad0-90a0-f3e6668f59e0', 'd771fd28-116c-43dd-984c-854405163e70', '00c88bca-5946-4bb4-916a-c631d210374c', '48a0eaf6-391e-44e9-8777-05a57ba9bb7f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:47.299567 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] Terminate volume connection completed successfully. Nov 06 21:07:47.319574 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-76563416-0117-4243-bb09-fedbafa0f850 tempest-VolumesBackupsV39Test-1523267356 None] Remove volume export completed successfully. Nov 06 21:07:47.353982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:47.416963 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:47.490032 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:47.494215 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] Deleted volume successfully. Nov 06 21:07:47.510464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26b80773-0115-41f6-9db2-5fab516d9080 tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-2dad8578-ac6c-4463-8357-1e91eb1479ea-delete_volume'" released by "delete_volume" :: held 1.548s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:48.216839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-e183a24a-92f4-4dfb-889f-619e91dbbdb9-delete_volume'" acquired by "delete_volume" :: waited 0.023s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:48.291371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:48.398200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:48.412601 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] deleting rbd volume volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:48.939447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:07:48.980773 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] deleting parent snapshot volume-e183a24a-92f4-4dfb-889f-619e91dbbdb9.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:07:49.273729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Lock "b'cinder-0c88cbc9-1cec-436f-a0a3-3093c6540c96-delete_volume'" acquired by "delete_volume" :: waited 0.035s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:49.369674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:50.233178 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Volume volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:50.270724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] deleting rbd volume volume-0c88cbc9-1cec-436f-a0a3-3093c6540c96 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:50.338337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] Created reservations ['efc51b92-3ee2-4a55-b3da-cc8ee8d31def', '5339601b-6594-401b-bc1f-53315bd63a40', '641bf3a0-b5c8-4fdd-8c6c-8aae1b22dddc', '3a94150e-a8a6-4eaa-9296-54425df80af7'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:50.351549 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:50.365696 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:50.368527 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:50.400790 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Flow 'volume_create_manager' (a9b93433-7677-490d-9e3b-bf36c05ac4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:50.407835 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2d5062-4c61-4cbd-9280-56ee8d823bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.467011 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:50.507366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff2d5062-4c61-4cbd-9280-56ee8d823bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1157442687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7a5871d3-6398-4a4d-9e14-9b406460f719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='930a318a21a4455c8d2c6eb794459b51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:50Z,use_quota=True,user_id='4ef3f8eee14643889cf3f3ccf5858c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.514814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917345ed-b35a-439e-bddd-06986033a44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.521840 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (917345ed-b35a-439e-bddd-06986033a44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.525091 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a58a85f-98c0-4fba-9dae-02ee9df59ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.532178 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a58a85f-98c0-4fba-9dae-02ee9df59ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5871d3-6398-4a4d-9e14-9b406460f719', 'volume_name': 'volume-7a5871d3-6398-4a4d-9e14-9b406460f719', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.537081 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4dbaa-14b9-46b6-8de8-a63ba85a0b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.541360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64d4dbaa-14b9-46b6-8de8-a63ba85a0b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.548851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba219d2-204f-4a8b-8973-b848f7f2a5a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.549856 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Volume 7a5871d3-6398-4a4d-9e14-9b406460f719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5871d3-6398-4a4d-9e14-9b406460f719', 'volume_size': 1} Nov 06 21:07:50.550419 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] creating volume 'volume-7a5871d3-6398-4a4d-9e14-9b406460f719' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:50.558594 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:50.655865 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:50.730676 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:50.785053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:50.798063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:50.799070 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:50.805077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba219d2-204f-4a8b-8973-b848f7f2a5a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5871d3-6398-4a4d-9e14-9b406460f719', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.807638 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d9ee07-0cc7-47bb-a537-749456b969b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:50.834479 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] Deleted volume successfully. Nov 06 21:07:50.849364 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Volume volume-7a5871d3-6398-4a4d-9e14-9b406460f719 (7a5871d3-6398-4a4d-9e14-9b406460f719): created successfully Nov 06 21:07:50.851619 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56d9ee07-0cc7-47bb-a537-749456b969b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:50.854687 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Flow 'volume_create_manager' (a9b93433-7677-490d-9e3b-bf36c05ac4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:50.885206 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-332b2bd8-e402-414d-9073-1bf03fb6e58e tempest-ServersNegativeTestJSON-1908266986 None] Created volume successfully. Nov 06 21:07:50.930214 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Created reservations ['9f479bc4-2284-4e1d-abd9-c3f6083a0a8e', 'ba46f169-df17-4b1f-8d69-af39336c973b', 'a017dce4-70ee-460b-83a1-50b3826aa550', 'f0ffc146-147f-44fb-9174-0818619ec229'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:50.938437 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-de8ac99b-a323-4f81-9b04-5838eadf99ec tempest-VolumesCloneTest-2126036681 None] Lock "b'cinder-e183a24a-92f4-4dfb-889f-619e91dbbdb9-delete_volume'" released by "delete_volume" :: held 2.720s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:50.993094 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:51.049056 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:51.120550 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:51.125628 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Deleted volume successfully. Nov 06 21:07:51.143951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8b32a72d-b2fa-42bb-aadc-ace7c0330134 tempest-VolumesBackupsV39Test-1523267356 None] Lock "b'cinder-0c88cbc9-1cec-436f-a0a3-3093c6540c96-delete_volume'" released by "delete_volume" :: held 1.870s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:07:56.259006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:56.267150 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:56.267600 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:56.305582 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Flow 'volume_create_manager' (6cfd0b1c-215e-4711-b61b-230c75e8e107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:56.322168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30156ca5-8b75-4135-a794-29356c307c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.345635 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:56.393806 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30156ca5-8b75-4135-a794-29356c307c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-842790943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=482a9edf-bcb1-4b32-85dc-a066e7bf1bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b512f3f002d4176808c9ea78c759467',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:56Z,use_quota=True,user_id='48334679063d40429b42fddf3d7f03ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.396326 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ec3ce6-3abf-4f67-9121-17dcf15b3908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.398436 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ec3ce6-3abf-4f67-9121-17dcf15b3908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.400760 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030be635-cf6b-41eb-beec-1ef783ae1158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.408836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (030be635-cf6b-41eb-beec-1ef783ae1158) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '482a9edf-bcb1-4b32-85dc-a066e7bf1bb7', 'volume_name': 'volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.412324 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabddeb2-01f2-41a0-a4d9-da6887869043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.415615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabddeb2-01f2-41a0-a4d9-da6887869043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.417599 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db7620-7f04-4945-9754-733a176ad492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.418528 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Volume 482a9edf-bcb1-4b32-85dc-a066e7bf1bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7', 'volume_size': 1} Nov 06 21:07:56.419260 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] creating volume 'volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:56.421045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:56.495570 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:07:56.502384 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:07:56.503026 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:07:56.522249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Flow 'volume_create_manager' (151c65ca-a5e6-4345-b4c1-28e2256f862f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:56.526201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7387199-fe05-4f89-adb9-0a393fba4a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.536023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:56.536431 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:56.539747 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3db7620-7f04-4945-9754-733a176ad492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.549247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1297dd-091e-402b-a35e-cbb49a9868ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.567810 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:07:56.598199 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7387199-fe05-4f89-adb9-0a393fba4a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-19115146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b26051055f54f1ab8aed050cf54919b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:07:56Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:07:56Z,use_quota=True,user_id='d58a899038db4ac3ab1244ac957ba2b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.601996 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8383ed9b-21c8-44d1-a5cf-dc902bf6beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.604664 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8383ed9b-21c8-44d1-a5cf-dc902bf6beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.607122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3056013-3659-487e-b927-77093024d58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.610208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3056013-3659-487e-b927-77093024d58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60', 'volume_name': 'volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60', 'volume_size': 2}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.612746 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf5ed4-b35c-4782-bd7f-f18dadf46e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.616004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2acf5ed4-b35c-4782-bd7f-f18dadf46e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.618539 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f040427-716f-4364-b810-5fd341f32295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.619487 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Volume 17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60', 'volume_size': 2} Nov 06 21:07:56.620167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] creating volume 'volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:07:56.621316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:56.684629 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Volume volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7 (482a9edf-bcb1-4b32-85dc-a066e7bf1bb7): created successfully Nov 06 21:07:56.687688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad1297dd-091e-402b-a35e-cbb49a9868ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.693079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Flow 'volume_create_manager' (6cfd0b1c-215e-4711-b61b-230c75e8e107) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:56.719135 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-91ef1f94-defe-4fd5-97f8-6805f62f7d23 tempest-VolumesNegativeTest-1453129096 None] Created volume successfully. Nov 06 21:07:56.750148 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:07:56.750961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:07:56.754233 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f040427-716f-4364-b810-5fd341f32295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60', 'volume_size': 2}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.757852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eedca7e-27fa-4bfd-9920-ff1f7139d2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:07:56.770942 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Volume volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60 (17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60): created successfully Nov 06 21:07:56.773996 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eedca7e-27fa-4bfd-9920-ff1f7139d2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:07:56.780797 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Flow 'volume_create_manager' (151c65ca-a5e6-4345-b4c1-28e2256f862f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:07:56.794242 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-af512b33-98da-4b55-b472-05018910d643 tempest-VolumesCloneNegativeTest-2021895055 None] Created volume successfully. Nov 06 21:07:57.527559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Lock "b'cinder-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:07:57.594476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:57.706930 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:07:57.707267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Volume volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:07:57.722323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] deleting rbd volume volume-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:07:58.224267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Created reservations ['76df1f33-944e-46c2-8aae-f454f641c7c1', '15150384-6382-4ce9-b742-a70afff9fc00', '71fd3a21-fade-4c05-bcc0-2e9a95f09f2b', 'ef09444c-9c65-4369-904a-62665e0efc64'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:07:58.303961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:58.373011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:07:58.435316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:07:58.451445 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Deleted volume successfully. Nov 06 21:07:58.471085 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ec7ed389-166c-4fad-9569-d6dac79bdafb tempest-VolumesCloneNegativeTest-2021895055 None] Lock "b'cinder-17aae1ef-7753-4a5b-b9b4-e76a3d9a8c60-delete_volume'" released by "delete_volume" :: held 0.943s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:08:02.849907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:08:02.856616 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:08:02.858576 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:08:02.889432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Flow 'volume_create_manager' (d41b80b2-0019-48b6-ad0e-458617e2ab51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:08:02.892256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c24a37c-834f-4730-ac62-9561c18c072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:02.909623 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:08:02.929277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c24a37c-834f-4730-ac62-9561c18c072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:08:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-548890503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=76f12d49-876b-4196-9d82-7eee8f335973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aad4f7753934ed4968da3d1440a42a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:08:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:08:03Z,use_quota=True,user_id='8d96e0600d8442fc93cfa9dadff81ea4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:02.933832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f1a646-3b04-4edf-b377-c48847c91848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:02.936013 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f1a646-3b04-4edf-b377-c48847c91848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:02.938748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9673f71-0da8-45f8-9de8-5c31a84b5d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:02.942497 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9673f71-0da8-45f8-9de8-5c31a84b5d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f12d49-876b-4196-9d82-7eee8f335973', 'volume_name': 'volume-76f12d49-876b-4196-9d82-7eee8f335973', 'volume_size': 2}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:02.945280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798b70c7-5242-4d7f-bf27-2ef2986031a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:02.948679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798b70c7-5242-4d7f-bf27-2ef2986031a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:02.951770 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44853dbd-7276-4cde-b9b2-780a92ce39ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:02.965919 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Volume 76f12d49-876b-4196-9d82-7eee8f335973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f12d49-876b-4196-9d82-7eee8f335973', 'volume_size': 2} Nov 06 21:08:02.967287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] creating volume 'volume-76f12d49-876b-4196-9d82-7eee8f335973' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:08:02.973239 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:03.114163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:08:03.115250 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:08:03.118332 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44853dbd-7276-4cde-b9b2-780a92ce39ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f12d49-876b-4196-9d82-7eee8f335973', 'volume_size': 2}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:03.120583 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabe56ce-8c70-4d6f-9f2f-4784f9a8a68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:08:03.138074 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Volume volume-76f12d49-876b-4196-9d82-7eee8f335973 (76f12d49-876b-4196-9d82-7eee8f335973): created successfully Nov 06 21:08:03.141050 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eabe56ce-8c70-4d6f-9f2f-4784f9a8a68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:08:03.144359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Flow 'volume_create_manager' (d41b80b2-0019-48b6-ad0e-458617e2ab51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:08:03.156539 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bcc892c6-9095-483d-9b72-56a82dc0e6a7 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Created volume successfully. Nov 06 21:08:04.291110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-f1e66070-5614-4f08-90ae-c5e780d05879 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:04.634473 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-f1e66070-5614-4f08-90ae-c5e780d05879 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Create snapshot completed successfully Nov 06 21:08:05.483542 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bbbeebc1-887b-4f15-bfbb-b610e68e3e18 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Lock "b'cinder-f452370a-d1d0-4f6b-ba45-b165e69fb03f-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:08:05.502331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbbeebc1-887b-4f15-bfbb-b610e68e3e18 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:06.664438 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bbbeebc1-887b-4f15-bfbb-b610e68e3e18 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Created reservations ['d2a51606-8f0d-4f4e-b899-51bd63e16d19', '12c6bc1c-2955-43a4-adfc-f1db1c139f15', '7cf42766-7e6b-46c8-bcf9-bb46d962483a', '3f190cb6-7672-4510-8dbd-6ea61c2e0ede'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:08:06.702502 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bbbeebc1-887b-4f15-bfbb-b610e68e3e18 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Delete snapshot completed successfully. Nov 06 21:08:06.711917 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bbbeebc1-887b-4f15-bfbb-b610e68e3e18 tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Lock "b'cinder-f452370a-d1d0-4f6b-ba45-b165e69fb03f-delete_snapshot'" released by "delete_snapshot" :: held 1.229s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:08:07.668984 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Lock "b'cinder-76f12d49-876b-4196-9d82-7eee8f335973-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:08:07.713499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:07.761570 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:08:07.761949 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Volume volume-76f12d49-876b-4196-9d82-7eee8f335973 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:08:07.768106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] deleting rbd volume volume-76f12d49-876b-4196-9d82-7eee8f335973 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:08:08.054283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Created reservations ['3ccb3784-ddba-4664-8827-52e8bcb47e60', '6caee4ef-1db9-4ca3-827d-3e29df040ae0', '7a0a9a48-2d3b-42c9-b4d9-2ea271c38b3a', 'da300b06-4080-428c-b319-ced847a2d2ee'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:08:08.098167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:08.126605 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:08.184111 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:08:08.188235 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Deleted volume successfully. Nov 06 21:08:08.207102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4e880924-b37d-495d-9c8d-a816c1b6d76f tempest-VolumesSnapshotNegativeTestJSON-262926983 None] Lock "b'cinder-76f12d49-876b-4196-9d82-7eee8f335973-delete_volume'" released by "delete_volume" :: held 0.538s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:08:10.097674 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:08:10.098255 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:10.121413 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:10.145090 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:08:20.254824 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Lock "b'cinder-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7-delete_volume'" acquired by "delete_volume" :: waited 0.021s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:08:20.305004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:20.368110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:08:20.369158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Volume volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:08:20.380372 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] deleting rbd volume volume-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:08:20.795649 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Created reservations ['362fc3fe-c843-4876-8fbf-fa806b5ae0ca', 'b6553e2c-634e-4163-b0a6-9a45ec64fde6', 'bbd4f18c-fd90-4db5-ae84-08b8e8f2f0f2', 'd4198306-491f-41a7-9ba0-52b8776fc08c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:08:20.844009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:20.906358 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:20.965720 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:08:20.971554 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Deleted volume successfully. Nov 06 21:08:20.988122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8a378c16-594a-48e7-9efe-ae5e371bdb53 tempest-VolumesNegativeTest-1453129096 None] Lock "b'cinder-482a9edf-bcb1-4b32-85dc-a066e7bf1bb7-delete_volume'" released by "delete_volume" :: held 0.733s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:08:28.940522 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-a91ea580-9000-40f2-a467-5840868f2bdf tempest-ServersTestBootFromVolume-1142499360 None] Terminate volume connection completed successfully. Nov 06 21:08:28.941164 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-a91ea580-9000-40f2-a467-5840868f2bdf tempest-ServersTestBootFromVolume-1142499360 None] Deleting attachment d639ac71-2670-45ae-9b50-69bb91291024. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:08:29.180434 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] Lock "b'cinder-638379a3-bc48-41a4-a0c4-976ee1563a2c-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:08:29.226142 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:29.342256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:08:29.359061 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] deleting rbd volume volume-638379a3-bc48-41a4-a0c4-976ee1563a2c {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:08:29.886060 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:08:29.945714 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] deleting parent snapshot volume-638379a3-bc48-41a4-a0c4-976ee1563a2c.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:08:30.872830 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] Created reservations ['37322603-aca7-4c9a-be33-df839bbc077c', 'a47b78cb-501a-447e-9a65-ed2f03c25c29', '9dfe9f1f-0a29-45bf-b493-7ec32b57349f', '8abe6236-e850-4300-a714-77eb130f32af'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:08:30.962530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:31.028081 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:08:31.094300 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:08:31.099209 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] Deleted volume successfully. Nov 06 21:08:31.133375 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-9e65f7ad-67a3-4d4d-b82c-4b259f290821 req-3fd1227a-1d03-4736-b24d-6573d9eee1a9 tempest-ServersTestBootFromVolume-1142499360 None] Lock "b'cinder-638379a3-bc48-41a4-a0c4-976ee1563a2c-delete_volume'" released by "delete_volume" :: held 1.953s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:09:10.100135 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:09:10.100815 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:10.181257 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:10.237150 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:09:40.022574 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Lock "b'cinder-7a5871d3-6398-4a4d-9e14-9b406460f719-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:09:40.068410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:40.109028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:09:40.109525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Volume volume-7a5871d3-6398-4a4d-9e14-9b406460f719 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:09:40.115277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] deleting rbd volume volume-7a5871d3-6398-4a4d-9e14-9b406460f719 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:09:40.353495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Created reservations ['edd7e22e-4d9c-40eb-9df5-1c209a955eff', '882381b7-29a7-480f-946e-b3f70e32290d', '4c9e702e-1d41-460a-956a-545e1e06b88b', '101762f8-a1f2-4c3b-87bb-d8b350a899b0'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:09:40.395387 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:40.417602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:40.455551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:09:40.459651 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Deleted volume successfully. Nov 06 21:09:40.472100 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-78f6934a-c12f-4d54-8695-3606f23f0234 tempest-ServersNegativeTestJSON-1908266986 None] Lock "b'cinder-7a5871d3-6398-4a4d-9e14-9b406460f719-delete_volume'" released by "delete_volume" :: held 0.450s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:09:41.151322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Lock "b'cinder-5b264d32-7085-4e51-90c3-0767a5710a13-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:09:41.181941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:41.219397 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:09:41.219815 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Volume volume-5b264d32-7085-4e51-90c3-0767a5710a13 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:09:41.225455 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] deleting rbd volume volume-5b264d32-7085-4e51-90c3-0767a5710a13 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:09:41.446579 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Created reservations ['e60395cd-d39d-4aba-98fb-b79f0d0f04d7', '7a486e66-5409-4c47-9e3b-5313d7021222', '630bcdd4-8a76-4983-96ed-a482711d82a9', '35fdf97b-f6e7-4738-8826-bc1fa0ef8ba5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:09:41.485354 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:41.506844 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:09:41.528369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:09:41.532334 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Deleted volume successfully. Nov 06 21:09:41.547084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-26add65c-6f18-4b22-9c00-26667470d6ce tempest-ServersNegativeTestJSON-1908266986 None] Lock "b'cinder-5b264d32-7085-4e51-90c3-0767a5710a13-delete_volume'" released by "delete_volume" :: held 0.396s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:09:57.648833 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fb2cc727-f9a5-45dc-891d-3d72d036a902 tempest-BackendsCapabilitiesAdminTestsJSON-1076426489 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:bb7c4f49-4c43-48e3-a26b-9f8a53cc7fd9:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127482) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 06 21:09:57.682883 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1db454a-fdf9-4cf6-89f8-df58194dca28 tempest-BackendsCapabilitiesAdminTestsJSON-1076426489 None] Obtained capabilities list: {'vendor_name': 'Open Source', 'driver_version': '1.2.0', 'storage_protocol': 'ceph', 'total_capacity_gb': 19.94, 'free_capacity_gb': 19.94, 'reserved_percentage': 0, 'multiattach': True, 'thin_provisioning_support': True, 'max_over_subscription_ratio': '20.0', 'location_info': 'ceph:/etc/ceph/ceph.conf:bb7c4f49-4c43-48e3-a26b-9f8a53cc7fd9:cinder:volumes', 'backend_state': 'up', 'volume_backend_name': 'ceph', 'replication_enabled': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=127482) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4729}} Nov 06 21:10:06.477444 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a128792a-e471-406c-94b3-33d4848e87c5 tempest-GroupsTest-70157991 None] Group tempest-Group1-1929171502: creating Nov 06 21:10:06.494488 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a128792a-e471-406c-94b3-33d4848e87c5 tempest-GroupsTest-70157991 None] Group tempest-Group1-1929171502: created successfully Nov 06 21:10:06.503328 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a128792a-e471-406c-94b3-33d4848e87c5 tempest-GroupsTest-70157991 None] Create group completed successfully. Nov 06 21:10:07.648064 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e235d0cc-5e5f-4a05-9869-a084136eb216 tempest-GroupsTest-70157991 None] Group tempest-Group2-593381098: creating Nov 06 21:10:07.670845 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e235d0cc-5e5f-4a05-9869-a084136eb216 tempest-GroupsTest-70157991 None] Group tempest-Group2-593381098: created successfully Nov 06 21:10:07.680658 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e235d0cc-5e5f-4a05-9869-a084136eb216 tempest-GroupsTest-70157991 None] Create group completed successfully. Nov 06 21:10:09.059968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:09.063092 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:09.063530 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:09.075841 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (60675a2b-625a-441f-bcf7-826735885efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:09.079397 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a54715-dd70-4bb9-9bed-8729265c91d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.086060 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:09.101434 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2a54715-dd70-4bb9-9bed-8729265c91d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1734491761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d6a23207-4b12-4760-be9f-dbf087d9b75b,host='ncdv-master-1@ceph#ceph',id=4c163b65-a755-4ce8-b025-3a38b4662ada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18493ac8ec344e509b393a781dd24ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:09Z,use_quota=True,user_id='52c873e3959f42b195c9858e2aa57757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a07cb4cf-abd2-40e8-9dcb-b5dbdd4952eb),volume_type_id=a07cb4cf-abd2-40e8-9dcb-b5dbdd4952eb)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.103911 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f50c45-7584-4fe6-9121-979e77fa85b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.106935 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f50c45-7584-4fe6-9121-979e77fa85b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.109248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e308680b-31ed-4b51-9b31-7de2318ccf5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.111418 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e308680b-31ed-4b51-9b31-7de2318ccf5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c163b65-a755-4ce8-b025-3a38b4662ada', 'volume_name': 'volume-4c163b65-a755-4ce8-b025-3a38b4662ada', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.113733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90baef1d-9d78-41a6-8fa1-3686393d5df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.115895 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90baef1d-9d78-41a6-8fa1-3686393d5df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.118006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c69a7a-b2d1-48a1-a381-5bcf7ce618d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.146285 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Volume 4c163b65-a755-4ce8-b025-3a38b4662ada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c163b65-a755-4ce8-b025-3a38b4662ada', 'volume_size': 1} Nov 06 21:10:09.146659 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] creating volume 'volume-4c163b65-a755-4ce8-b025-3a38b4662ada' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:09.147660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:09.204842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:09.205346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:09.207787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5c69a7a-b2d1-48a1-a381-5bcf7ce618d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c163b65-a755-4ce8-b025-3a38b4662ada', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.210242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb68628f-ee9d-421c-8ef0-2319fbd9f63a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:09.220566 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Volume volume-4c163b65-a755-4ce8-b025-3a38b4662ada (4c163b65-a755-4ce8-b025-3a38b4662ada): created successfully Nov 06 21:10:09.222389 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb68628f-ee9d-421c-8ef0-2319fbd9f63a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:09.225231 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (60675a2b-625a-441f-bcf7-826735885efe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:09.233936 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c52b9c2f-ebac-4c8a-a15c-0187656657b5 tempest-GroupsTest-70157991 None] Created volume successfully. Nov 06 21:10:10.102540 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:10:10.104748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:10.158562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:10.188932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:10.643522 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:10.717124 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:10.718135 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Volume volume-4c163b65-a755-4ce8-b025-3a38b4662ada is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:10.725128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] deleting rbd volume volume-4c163b65-a755-4ce8-b025-3a38b4662ada {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:11.027059 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Created reservations ['37c4fee8-3b49-4ffa-abf7-bada02230e28'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:11.044020 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-641946810 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-641946810, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:10:11.044844 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-641946810 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-641946810, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:10:11.074362 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Created reservations ['194adba5-386c-47fb-8b65-72b99d656514', '332bd418-c356-48b1-889a-fb8f86aa2ec8', '2e4fce5d-6f3e-4556-9da0-2eb8bdf7008f', '226c6e44-0d8c-4458-bab5-0092a8acf947'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:11.208674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:11.265889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:11.315741 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:11.320921 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-929423d4-3370-4f97-80a8-cd7bb1367e92 tempest-GroupsTest-70157991 None] Delete group completed successfully. Nov 06 21:10:11.867816 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-54fd14a1-b3d9-4a70-9db8-cc2dfb712f3f tempest-GroupsTest-70157991 None] Created reservations ['cb5298ab-5684-4490-a7af-a5710e63e25f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:11.908523 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54fd14a1-b3d9-4a70-9db8-cc2dfb712f3f tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:11.938131 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54fd14a1-b3d9-4a70-9db8-cc2dfb712f3f tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:11.967748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-54fd14a1-b3d9-4a70-9db8-cc2dfb712f3f tempest-GroupsTest-70157991 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:11.971719 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-54fd14a1-b3d9-4a70-9db8-cc2dfb712f3f tempest-GroupsTest-70157991 None] Delete group completed successfully. Nov 06 21:10:13.280626 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a4bfbe8e-38d0-4024-afff-7fb52fd35397 tempest-GroupsTest-70157991 None] Group tempest-GroupsTest-Group-842606095: creating Nov 06 21:10:13.297417 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a4bfbe8e-38d0-4024-afff-7fb52fd35397 tempest-GroupsTest-70157991 None] Group tempest-GroupsTest-Group-842606095: created successfully Nov 06 21:10:13.305718 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a4bfbe8e-38d0-4024-afff-7fb52fd35397 tempest-GroupsTest-70157991 None] Create group completed successfully. Nov 06 21:10:14.755711 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:14.759713 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:14.760152 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:14.775022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (b646ec83-31aa-4e9d-9d20-31c48956c7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:14.778012 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af59c7d1-ee90-4091-b10b-1cdde188a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.786039 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:14.807323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af59c7d1-ee90-4091-b10b-1cdde188a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-2098518190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7341bdf-411d-473e-9160-6118a75b0b49,host='ncdv-master-1@ceph#ceph',id=dbbeaa8b-5544-4e4e-8aeb-c69fb1754421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18493ac8ec344e509b393a781dd24ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:15Z,use_quota=True,user_id='52c873e3959f42b195c9858e2aa57757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbbf146-dec0-4244-afa7-3f8a9ec6e3c7),volume_type_id=5dbbf146-dec0-4244-afa7-3f8a9ec6e3c7)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.809872 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0249e9-d346-456c-a892-6112f61afde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.811925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e0249e9-d346-456c-a892-6112f61afde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.815002 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84f9316-8fbc-4376-b33f-bd9c93d16059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.817222 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84f9316-8fbc-4376-b33f-bd9c93d16059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbeaa8b-5544-4e4e-8aeb-c69fb1754421', 'volume_name': 'volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.819410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387a5d64-e7e7-4d4f-b8bd-29c2aa9e9d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.822048 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387a5d64-e7e7-4d4f-b8bd-29c2aa9e9d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.824366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc046a-85d5-47ac-8377-c6bd1938b189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.838426 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Volume dbbeaa8b-5544-4e4e-8aeb-c69fb1754421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421', 'volume_size': 1} Nov 06 21:10:14.838969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] creating volume 'volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:14.841242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:14.903962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:14.904361 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:14.906420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94fc046a-85d5-47ac-8377-c6bd1938b189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.908899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f51ca2-d44e-4a7b-948a-2ed3f0a6b86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:14.917992 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Volume volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421 (dbbeaa8b-5544-4e4e-8aeb-c69fb1754421): created successfully Nov 06 21:10:14.919900 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2f51ca2-d44e-4a7b-948a-2ed3f0a6b86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:14.922865 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (b646ec83-31aa-4e9d-9d20-31c48956c7d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:14.931555 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a80d825c-6233-4a9d-8cc1-54259a0c41b7 tempest-GroupsTest-70157991 None] Created volume successfully. Nov 06 21:10:16.340953 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:16.346240 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:16.347358 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:16.359627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (a1118063-70d4-4241-a3dc-3f7b047f81b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:16.362873 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed19537f-f6e4-4be5-9406-098eb2a5c093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.369708 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:16.382406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed19537f-f6e4-4be5-9406-098eb2a5c093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsTest-Volume-465367175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f7341bdf-411d-473e-9160-6118a75b0b49,host='ncdv-master-1@ceph#ceph',id=dd5d51df-0c1f-48d4-b502-2f6421f9f33e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18493ac8ec344e509b393a781dd24ee8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:16Z,use_quota=True,user_id='52c873e3959f42b195c9858e2aa57757',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5dbbf146-dec0-4244-afa7-3f8a9ec6e3c7),volume_type_id=5dbbf146-dec0-4244-afa7-3f8a9ec6e3c7)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.385536 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5bb02-f2e4-4f84-9a7a-e5f268461e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.387752 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (63c5bb02-f2e4-4f84-9a7a-e5f268461e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.390069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8014b4-0a2b-4b82-91f4-9b55a51b19c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.392422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f8014b4-0a2b-4b82-91f4-9b55a51b19c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd5d51df-0c1f-48d4-b502-2f6421f9f33e', 'volume_name': 'volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.395208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e62311-d453-4c99-a630-571c8d62b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.397185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15e62311-d453-4c99-a630-571c8d62b72f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.399322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d627b482-fe4a-4810-9304-a6d09f8bc78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.413011 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Volume dd5d51df-0c1f-48d4-b502-2f6421f9f33e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e', 'volume_size': 1} Nov 06 21:10:16.413416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] creating volume 'volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:16.414435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:16.513398 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:16.513679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:16.515738 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d627b482-fe4a-4810-9304-a6d09f8bc78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.518029 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80aecf7-2206-49ef-8d4f-b75cf17c8065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.530710 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Volume volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e (dd5d51df-0c1f-48d4-b502-2f6421f9f33e): created successfully Nov 06 21:10:16.532645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c80aecf7-2206-49ef-8d4f-b75cf17c8065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.536049 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Flow 'volume_create_manager' (a1118063-70d4-4241-a3dc-3f7b047f81b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:16.545648 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ada8b4e0-ab34-4834-807c-b9aecbb58550 tempest-GroupsTest-70157991 None] Created volume successfully. Nov 06 21:10:16.946026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:16.950534 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:16.951267 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:16.964221 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (3b21d78a-bc1c-4b38-93f1-2ad7fff466c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:16.967634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75eb648d-5dce-41fc-8c6f-fd6a841c4aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.974049 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:16.988246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75eb648d-5dce-41fc-8c6f-fd6a841c4aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1055901583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5922c86c-184f-4d10-9008-1de074a050e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ddbc94d984ebb9aa64f586ae2fbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:17Z,use_quota=True,user_id='1c526b6ddfc74a84b74b8f2608a0ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.991250 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120b2e07-6684-469a-9ed9-163dfc0fcd61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.993401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (120b2e07-6684-469a-9ed9-163dfc0fcd61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:16.996250 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5440b8-0a68-43f4-9625-ca618abbbb4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:16.998437 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee5440b8-0a68-43f4-9625-ca618abbbb4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5922c86c-184f-4d10-9008-1de074a050e6', 'volume_name': 'volume-5922c86c-184f-4d10-9008-1de074a050e6', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:17.000825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bf5ffd-6f43-44b2-bf06-5afc1f04cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:17.002861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96bf5ffd-6f43-44b2-bf06-5afc1f04cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:17.005389 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c91b16-9a5d-49e1-b0e5-5c5873bc6b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:17.006156 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Volume 5922c86c-184f-4d10-9008-1de074a050e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5922c86c-184f-4d10-9008-1de074a050e6', 'volume_size': 1} Nov 06 21:10:17.006546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] creating volume 'volume-5922c86c-184f-4d10-9008-1de074a050e6' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:17.007515 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:17.078650 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:17.079316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:17.081426 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8c91b16-9a5d-49e1-b0e5-5c5873bc6b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5922c86c-184f-4d10-9008-1de074a050e6', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:17.083556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c18058-6585-4717-a502-8f346e001463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:17.093501 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-5922c86c-184f-4d10-9008-1de074a050e6 (5922c86c-184f-4d10-9008-1de074a050e6): created successfully Nov 06 21:10:17.095501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6c18058-6585-4717-a502-8f346e001463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:17.098455 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (3b21d78a-bc1c-4b38-93f1-2ad7fff466c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:17.108011 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b3f7c4ad-bfd9-4e16-98cd-497a76982af4 tempest-AttachVolumeTestJSON-2096905218 None] Created volume successfully. Nov 06 21:10:17.557156 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9bc9f6a0-da78-4bf0-affe-c59b47b84ddd tempest-GroupsTest-70157991 None] Update group completed successfully. Nov 06 21:10:18.452871 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4584df55-a994-4f7c-834b-6a11010988cc req-68192697-643d-47dd-879f-0dfd2a3be6d0 tempest-AttachVolumeTestJSON-2096905218 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:10:18.989871 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-83e4be03-653d-4b67-acda-049f5cc643d0 tempest-GroupsTest-70157991 None] Update group completed successfully. Nov 06 21:10:19.341473 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4584df55-a994-4f7c-834b-6a11010988cc req-68192697-643d-47dd-879f-0dfd2a3be6d0 tempest-AttachVolumeTestJSON-2096905218 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.889s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:10:19.342554 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-4584df55-a994-4f7c-834b-6a11010988cc req-68192697-643d-47dd-879f-0dfd2a3be6d0 tempest-AttachVolumeTestJSON-2096905218 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5922c86c-184f-4d10-9008-1de074a050e6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '5922c86c-184f-4d10-9008-1de074a050e6', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:10:19.369698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-4584df55-a994-4f7c-834b-6a11010988cc req-68192697-643d-47dd-879f-0dfd2a3be6d0 tempest-AttachVolumeTestJSON-2096905218 None] Connection info returned from driver {'name': 'volumes/volume-5922c86c-184f-4d10-9008-1de074a050e6', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5922c86c-184f-4d10-9008-1de074a050e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'e26e8967-7ff0-4f35-9ed4-8ff169fef4d6'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:10:19.432003 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-4584df55-a994-4f7c-834b-6a11010988cc req-68192697-643d-47dd-879f-0dfd2a3be6d0 tempest-AttachVolumeTestJSON-2096905218 None] attachment_update completed successfully. Nov 06 21:10:20.454873 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:20.547542 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:20.548508 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Volume volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:20.556939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] deleting rbd volume volume-dbbeaa8b-5544-4e4e-8aeb-c69fb1754421 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:20.809786 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:20.851012 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:20.851436 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Volume volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:20.858841 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] deleting rbd volume volume-dd5d51df-0c1f-48d4-b502-2f6421f9f33e {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:21.125970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Created reservations ['54505181-d718-4aae-8146-f96a5b1506f2'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:21.142842 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-695552825 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-695552825, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:10:21.143635 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-695552825 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-695552825, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:10:21.157476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Created reservations ['68f6e957-a306-42da-a3dc-e814bbc65074', '2cbb18ab-c142-499e-b289-6eddb607c21e', '95031a59-a4b3-4e51-b25d-d56fce24efae', '9a5af6d6-0ad8-4073-bf7d-6d7c391080e5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:21.235025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Created reservations ['ca8b07a5-7867-4d13-b474-960a17499502', '1af3816b-d097-4682-ac9b-5e4cd6e0b78e', 'ea27b087-b84f-4aed-a83c-2b7a21e190ae', '4ffa0b86-9453-450e-8c45-c87f8ee35b88'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:21.309878 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:21.332842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:21.361851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:21.366342 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-481982e6-8dcd-4c22-8cfa-262ceac53716 tempest-GroupsTest-70157991 None] Delete group completed successfully. Nov 06 21:10:33.797053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:33.801069 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:33.801524 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:33.814264 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (96011f9f-2a4b-4507-af7f-867bfc67485a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:33.817437 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1333b8e0-9c74-41f2-970a-ef7abe1194f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.825255 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:33.841632 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1333b8e0-9c74-41f2-970a-ef7abe1194f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1399420673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=00c6c36f-6007-4209-92b7-fc77b5ec972b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:34Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.844153 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c9c77-6f9f-43c6-9df6-65991fcbbea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.846467 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01c9c77-6f9f-43c6-9df6-65991fcbbea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.848789 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b06272-681a-49bb-93cf-f8bae61ec0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.850958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56b06272-681a-49bb-93cf-f8bae61ec0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c6c36f-6007-4209-92b7-fc77b5ec972b', 'volume_name': 'volume-00c6c36f-6007-4209-92b7-fc77b5ec972b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.853288 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122d6202-a86f-471d-a433-be56d6f3401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.855300 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (122d6202-a86f-471d-a433-be56d6f3401f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.857679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc3c9f4-d283-446b-a669-555ae1efca0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.858617 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Volume 00c6c36f-6007-4209-92b7-fc77b5ec972b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c6c36f-6007-4209-92b7-fc77b5ec972b', 'volume_size': 1} Nov 06 21:10:33.859159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] creating volume 'volume-00c6c36f-6007-4209-92b7-fc77b5ec972b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:33.860275 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:33.965125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:33.965501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:33.967458 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fc3c9f4-d283-446b-a669-555ae1efca0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c6c36f-6007-4209-92b7-fc77b5ec972b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.969562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a740ca-9b5f-47ad-9926-369ef0aaa8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:33.977975 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Volume volume-00c6c36f-6007-4209-92b7-fc77b5ec972b (00c6c36f-6007-4209-92b7-fc77b5ec972b): created successfully Nov 06 21:10:33.980749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a740ca-9b5f-47ad-9926-369ef0aaa8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:33.983776 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (96011f9f-2a4b-4507-af7f-867bfc67485a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:33.991571 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-84fd0b3c-c69c-493a-ad4e-8782afb2a5ce tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:35.321917 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:35.325505 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:35.325951 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:35.338313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (9dece6db-1670-450d-86ea-3bae5c43e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:35.341390 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f311eb-3819-4094-90be-0b734bedaddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.347580 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:35.359625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f311eb-3819-4094-90be-0b734bedaddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1086958003',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d1c5432d-9654-4ac0-9560-ce9e521afdd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:35Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.362162 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26565494-d6d5-4564-a10c-2b57ff39242b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.364211 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26565494-d6d5-4564-a10c-2b57ff39242b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.366554 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e5d7c9-ede4-4b21-96a7-b7ea6abfeebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.368824 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0e5d7c9-ede4-4b21-96a7-b7ea6abfeebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1c5432d-9654-4ac0-9560-ce9e521afdd8', 'volume_name': 'volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.370951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7114783c-f664-46c5-ad23-d6684dac6802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.373003 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7114783c-f664-46c5-ad23-d6684dac6802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.375102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3a128f-50cc-4fa5-9114-d0b1fca09025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.375843 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Volume d1c5432d-9654-4ac0-9560-ce9e521afdd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8', 'volume_size': 1} Nov 06 21:10:35.376251 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] creating volume 'volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:35.379080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:35.441959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:35.442332 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:35.444312 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc3a128f-50cc-4fa5-9114-d0b1fca09025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.446945 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1a42b8-5938-4741-8c2d-b7bab90bc2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:35.455355 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Volume volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8 (d1c5432d-9654-4ac0-9560-ce9e521afdd8): created successfully Nov 06 21:10:35.457226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa1a42b8-5938-4741-8c2d-b7bab90bc2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:35.459993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (9dece6db-1670-450d-86ea-3bae5c43e155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:35.468200 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-91149462-8b64-495d-88ff-6a649ef84659 tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:36.431483 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-d1c5432d-9654-4ac0-9560-ce9e521afdd8-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:36.466096 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:36.509402 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:36.509825 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Volume volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:36.516744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-d1c5432d-9654-4ac0-9560-ce9e521afdd8 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:36.725730 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Created reservations ['b5994545-a0a4-4224-a48f-b13b16890507', '376efc7c-7f11-4962-a968-dd948a5b8941', 'f7f0582b-08b3-4a1b-91b3-b867879811f0', 'ab43a9f7-710e-4859-a101-8af3084ca6c5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:36.770153 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:36.803308 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:36.839285 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:36.844482 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:36.855381 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d6c3e3f2-3ea7-44ec-842f-509c80fb4c82 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-d1c5432d-9654-4ac0-9560-ce9e521afdd8-delete_volume'" released by "delete_volume" :: held 0.424s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:37.563175 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-00c6c36f-6007-4209-92b7-fc77b5ec972b-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:37.601469 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:37.641505 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:37.641949 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Volume volume-00c6c36f-6007-4209-92b7-fc77b5ec972b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:37.647122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-00c6c36f-6007-4209-92b7-fc77b5ec972b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:37.918884 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Created reservations ['15bbe3f5-64e7-4720-af78-c4586e67ed8a', '4f03b4e4-4b18-4ea0-ae7e-8cd2d02e8603', '04a551fa-9740-4e43-bc98-ef580e2eeecb', '02628db3-6dcb-4bea-99bc-664dc06671ad'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:37.962154 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:37.986457 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:38.011907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:38.016004 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:38.029956 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8df50f55-c1ae-47ff-873e-170cf7188a57 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-00c6c36f-6007-4209-92b7-fc77b5ec972b-delete_volume'" released by "delete_volume" :: held 0.467s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:38.914907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:38.919077 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:38.919523 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:38.932511 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (eaed8cc4-5639-4233-9b3b-80a051dc479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:38.934888 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56248d83-d884-4ee3-9598-b0251ada3282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:38.941556 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:38.958736 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56248d83-d884-4ee3-9598-b0251ada3282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1058503969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4740bc11-bd9b-4cad-80cb-e170eb0dec56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:39Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:38.961777 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3410a1f-09e4-4545-8968-5f62c5074f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:38.963860 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3410a1f-09e4-4545-8968-5f62c5074f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:38.966170 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc2fc70-9aab-4683-ad5b-8912e9dcfb84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:38.968342 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abc2fc70-9aab-4683-ad5b-8912e9dcfb84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'volume_name': 'volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:38.970613 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566cb43e-1f61-4a32-b4c0-f9eb1ddcb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:38.972561 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (566cb43e-1f61-4a32-b4c0-f9eb1ddcb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:38.974645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0d928-7891-4447-b4f0-7d9b99f48794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:38.975391 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Volume 4740bc11-bd9b-4cad-80cb-e170eb0dec56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'volume_size': 1} Nov 06 21:10:38.975779 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] creating volume 'volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:38.977407 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:39.035973 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:39.036521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:39.038541 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88b0d928-7891-4447-b4f0-7d9b99f48794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:39.040658 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ff9c30-57a4-43ec-aa5e-0070694581e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:39.049443 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Volume volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56 (4740bc11-bd9b-4cad-80cb-e170eb0dec56): created successfully Nov 06 21:10:39.051419 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4ff9c30-57a4-43ec-aa5e-0070694581e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:39.054341 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (eaed8cc4-5639-4233-9b3b-80a051dc479a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:39.062461 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-73066255-0a03-410e-8dda-6c40ad1ec91e tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:40.311706 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:40.315394 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:40.315846 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:40.338208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (88402ca8-ddc3-42d6-8cd0-eccdd19931e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:40.341684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1756db45-15b5-4209-b867-ae1e639188bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.349605 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:40.375491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1756db45-15b5-4209-b867-ae1e639188bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1444404093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=43d4d371-d5ec-46fe-a1fa-0290b587017d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4740bc11-bd9b-4cad-80cb-e170eb0dec56,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:40Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.379611 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe496c3a-6026-400d-ad9e-bf2b10027456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.382840 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe496c3a-6026-400d-ad9e-bf2b10027456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.385889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f172c592-ed1b-4b86-b906-c30600593c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.401830 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f172c592-ed1b-4b86-b906-c30600593c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '43d4d371-d5ec-46fe-a1fa-0290b587017d', 'volume_name': 'volume-43d4d371-d5ec-46fe-a1fa-0290b587017d', 'volume_size': 1, 'source_volid': '4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.404201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ec11f-9a79-4631-ac44-595afaa83cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.406662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ec11f-9a79-4631-ac44-595afaa83cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.409030 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a921ea7c-57c0-48ab-9a49-14568c71ec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.410266 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Volume 43d4d371-d5ec-46fe-a1fa-0290b587017d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-43d4d371-d5ec-46fe-a1fa-0290b587017d', 'volume_size': 1, 'source_volid': '4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'source_volstatus': 'available'} Nov 06 21:10:40.424619 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:40.468088 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] creating snapshot='volume-43d4d371-d5ec-46fe-a1fa-0290b587017d.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:10:40.779766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] cloning 'volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56@volume-43d4d371-d5ec-46fe-a1fa-0290b587017d.clone_snap' to 'volume-43d4d371-d5ec-46fe-a1fa-0290b587017d' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:10:40.903671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Volume volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:40.911541 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:40.911914 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:40.934210 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:10:40.936603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a921ea7c-57c0-48ab-9a49-14568c71ec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d4d371-d5ec-46fe-a1fa-0290b587017d', 'volume_size': 1, 'source_volid': '4740bc11-bd9b-4cad-80cb-e170eb0dec56', 'source_volstatus': 'available'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.939031 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e43aef-9b17-48ef-977a-7d7f5246d683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:40.951442 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Volume volume-43d4d371-d5ec-46fe-a1fa-0290b587017d (43d4d371-d5ec-46fe-a1fa-0290b587017d): created successfully Nov 06 21:10:40.953759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e43aef-9b17-48ef-977a-7d7f5246d683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:40.957064 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (88402ca8-ddc3-42d6-8cd0-eccdd19931e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:40.969672 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-901bc939-e7de-45e8-be2e-6d7d54891dbd tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:41.828360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:41.832892 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:41.833409 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:41.845548 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (bd14f895-2f54-409e-a24e-c8d42c31d802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:41.849074 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a201340-2918-4b3c-ac7f-6e2cceab632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.856216 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:41.875625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a201340-2918-4b3c-ac7f-6e2cceab632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-741564194',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a11b3ca6-194c-4416-8674-68ad4dd259fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:42Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.878386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c957e737-820a-4b5b-93c3-6418428b719b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.880690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c957e737-820a-4b5b-93c3-6418428b719b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.883903 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dc8d12-d04c-401d-9d77-c2008c1b096a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.886128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8dc8d12-d04c-401d-9d77-c2008c1b096a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a11b3ca6-194c-4416-8674-68ad4dd259fd', 'volume_name': 'volume-a11b3ca6-194c-4416-8674-68ad4dd259fd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.888359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8959c1-22f7-44b6-a3ef-0fae73abd23a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.890401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8959c1-22f7-44b6-a3ef-0fae73abd23a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.892530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce6c65-a27a-413a-ab6a-d626c6bdbecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.893293 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Volume a11b3ca6-194c-4416-8674-68ad4dd259fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a11b3ca6-194c-4416-8674-68ad4dd259fd', 'volume_size': 1} Nov 06 21:10:41.893685 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] creating volume 'volume-a11b3ca6-194c-4416-8674-68ad4dd259fd' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:41.894662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:41.965045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:41.965621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:41.967766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce6c65-a27a-413a-ab6a-d626c6bdbecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a11b3ca6-194c-4416-8674-68ad4dd259fd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.969936 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b79e009-3f86-4901-94eb-49702990f6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:41.979478 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Volume volume-a11b3ca6-194c-4416-8674-68ad4dd259fd (a11b3ca6-194c-4416-8674-68ad4dd259fd): created successfully Nov 06 21:10:41.981575 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b79e009-3f86-4901-94eb-49702990f6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:41.984476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (bd14f895-2f54-409e-a24e-c8d42c31d802) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:41.993062 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-54a252de-e2e7-4cd1-a4d9-084ba89c4d79 tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:42.944385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-a11b3ca6-194c-4416-8674-68ad4dd259fd-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:42.984929 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:43.028057 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:43.028486 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Volume volume-a11b3ca6-194c-4416-8674-68ad4dd259fd is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:43.034202 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-a11b3ca6-194c-4416-8674-68ad4dd259fd {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:43.290685 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Created reservations ['802e9100-4afc-4fa7-bda9-25422342f364', 'a1d25343-a178-4046-9f69-222955bc8501', '5c75183a-5d1b-401e-9541-e6b42bd44569', '5d77cf15-2840-492e-adb1-a0939c95d4ad'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:43.333254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:43.356106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:43.380773 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:43.385645 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:43.397104 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-889cc404-57f8-4326-9694-281710ea1143 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-a11b3ca6-194c-4416-8674-68ad4dd259fd-delete_volume'" released by "delete_volume" :: held 0.453s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:44.090902 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-43d4d371-d5ec-46fe-a1fa-0290b587017d-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:44.166501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:44.241220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:44.251410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-43d4d371-d5ec-46fe-a1fa-0290b587017d {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:44.504626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:10:44.532126 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Volume volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:44.533549 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] deleting parent snapshot volume-43d4d371-d5ec-46fe-a1fa-0290b587017d.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:10:45.385437 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Created reservations ['d6298606-061e-4ef7-b623-568a910804cf', '746e1374-8610-4391-9ed7-419f4fc4cd97', '09033674-c41a-4652-b980-7661922e394d', 'c31e383f-514e-478d-a6da-d6049e2cb26a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:45.432824 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:45.472604 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:45.503381 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:45.508653 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:45.522000 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-047914e7-45f8-4736-95e2-fde551d36038 tempest-VolumesGetTest-363233367 None] Lock "b'cinder-43d4d371-d5ec-46fe-a1fa-0290b587017d-delete_volume'" released by "delete_volume" :: held 1.431s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:46.704426 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:46.707768 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:46.708217 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:46.720405 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (e0da04e6-9b95-47d6-8e30-d5839a1e5d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:46.723491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b126e7a8-e02e-42a1-98a3-ea43dd9bdd7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:46.729980 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:46.742642 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b126e7a8-e02e-42a1-98a3-ea43dd9bdd7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-530487613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:47Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:46.745142 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca56a47-a1ba-423a-8d84-b7b8605bd2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:46.747217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ca56a47-a1ba-423a-8d84-b7b8605bd2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:46.749581 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56878713-001d-4438-9670-000c7c76dc2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:46.845811 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56878713-001d-4438-9670-000c7c76dc2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b', 'volume_name': 'volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:46.848086 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae746472-7671-4b83-b200-c79c182d9c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:46.850307 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae746472-7671-4b83-b200-c79c182d9c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:46.852516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529256ac-715f-47c4-ae72-3cd586a59320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:46.853371 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Volume dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:10:46.853939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Cloning dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:10:46.862904 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:46.876610 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 10, 46, 867799)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:10:46.877128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:10:46.877699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:10:46.886188 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.023s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:46.887143 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:10:46.892713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 10, 46, 890480)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:10:46.893117 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:10:46.893499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:10:46.904533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:46.955398 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] creating snapshot='volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:10:47.356758 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b.clone_snap' to 'volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:10:47.499532 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:47.505216 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:47.505591 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:47.525245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:10:47.525780 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Marking volume dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:10:47.534137 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:10:47.534695 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Creating volume glance metadata for volume dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:10:47.586224 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (529256ac-715f-47c4-ae72-3cd586a59320) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:47.588433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0d5ec1-d860-4f25-864e-74c9f0d0dd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:47.597112 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Volume volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b (dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b): created successfully Nov 06 21:10:47.599269 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e0d5ec1-d860-4f25-864e-74c9f0d0dd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:47.603003 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (e0da04e6-9b95-47d6-8e30-d5839a1e5d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:47.611959 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6501b7f8-e566-4e39-9afe-7864979be8aa tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:48.194856 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:10:48.198611 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:10:48.199049 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:10:48.210278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (96dfecae-9eba-4510-8144-18b14be33aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:48.216171 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7da0afb-e67d-4a1c-a4dd-57533230415d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.222672 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:10:48.239451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7da0afb-e67d-4a1c-a4dd-57533230415d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:10:48Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1361033965',display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e260b52c-37ae-426a-97ac-00605b510be2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e43f07163cc4b95adfaca43b70ecd60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:10:48Z,use_quota=True,user_id='f7b9494ba66346f8bf150dd994e10ca2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.241996 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39322760-e6e8-4cca-a999-a679063b2931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.244766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39322760-e6e8-4cca-a999-a679063b2931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.248228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5aad6-be7c-46b4-90f8-727b393900b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.249604 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc5aad6-be7c-46b4-90f8-727b393900b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e260b52c-37ae-426a-97ac-00605b510be2', 'volume_name': 'volume-e260b52c-37ae-426a-97ac-00605b510be2', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.252104 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793c2e-d864-49fb-932a-6378f7e2582e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.254165 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d793c2e-d864-49fb-932a-6378f7e2582e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.256245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f8b996-50f5-45c7-84f6-805f394e0a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.257014 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Volume e260b52c-37ae-426a-97ac-00605b510be2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e260b52c-37ae-426a-97ac-00605b510be2', 'volume_size': 1} Nov 06 21:10:48.257400 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] creating volume 'volume-e260b52c-37ae-426a-97ac-00605b510be2' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:10:48.258882 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:48.341061 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:10:48.341463 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:10:48.343741 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f8b996-50f5-45c7-84f6-805f394e0a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e260b52c-37ae-426a-97ac-00605b510be2', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.345968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92e04e2-1c2a-412f-87d8-fda4dbd4e593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:10:48.354638 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Volume volume-e260b52c-37ae-426a-97ac-00605b510be2 (e260b52c-37ae-426a-97ac-00605b510be2): created successfully Nov 06 21:10:48.356689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92e04e2-1c2a-412f-87d8-fda4dbd4e593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:10:48.359477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Flow 'volume_create_manager' (96dfecae-9eba-4510-8144-18b14be33aa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:10:48.367938 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9642a907-3a75-4fc2-9321-4b6bf515b21a tempest-VolumesGetTest-363233367 None] Created volume successfully. Nov 06 21:10:49.395385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Lock "b'cinder-e260b52c-37ae-426a-97ac-00605b510be2-delete_volume'" acquired by "delete_volume" :: waited 0.039s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:49.439690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:49.485470 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:49.486217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Volume volume-e260b52c-37ae-426a-97ac-00605b510be2 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:49.491645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-e260b52c-37ae-426a-97ac-00605b510be2 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:49.790839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Created reservations ['d5a3dc6c-42c6-4f92-97a9-89e678d271e0', '8d5a5f26-ad13-4d72-8ce7-6309190c316d', '7f7a49ef-d33d-4132-b7e2-932645c5a278', '685dbcca-ea68-49f9-b2e3-6a149eea8549'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:49.830292 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:49.858625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:49.902262 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:49.907759 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:49.922678 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-437fb24b-a9c1-4b8b-b5e7-863c66e4b5de tempest-VolumesGetTest-363233367 None] Lock "b'cinder-e260b52c-37ae-426a-97ac-00605b510be2-delete_volume'" released by "delete_volume" :: held 0.527s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:50.522372 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] Lock "b'cinder-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:50.563769 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:50.651725 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:50.661008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:50.905747 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:10:50.945137 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] deleting parent snapshot volume-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:10:51.462530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] Created reservations ['61191a44-45eb-4a50-a8c7-6c8aa76e1901', '82eb0baf-f780-4dde-928a-68162db8e37c', 'a6018f4a-2e99-4350-a823-09493c8805b7', 'ddbd58bc-4369-490d-8b6e-058753b85d51'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:51.514835 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:51.560276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:51.607415 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:51.624511 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:51.640857 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-dbbbc611-8e37-460b-9ace-f154771f5c5c tempest-VolumesGetTest-363233367 None] Lock "b'cinder-dc2e261f-5d1c-4d03-88fb-4cbd006bcc2b-delete_volume'" released by "delete_volume" :: held 1.118s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:10:51.688360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Lock "b'cinder-4740bc11-bd9b-4cad-80cb-e170eb0dec56-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:10:51.729695 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:51.783433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:10:51.783981 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Volume volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:10:51.792463 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] deleting rbd volume volume-4740bc11-bd9b-4cad-80cb-e170eb0dec56 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:10:52.069749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Created reservations ['fe83f640-3237-44a3-9673-b50f2320dd13', '25715bf6-81b0-4bbd-9349-5fa6123d71f0', '3947944d-af18-4723-b383-085c95f5f727', 'a18a32f0-e5a4-4c5f-b8de-578bf7eb0a95'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:10:52.126443 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:52.186526 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:10:52.219639 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:10:52.223208 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Deleted volume successfully. Nov 06 21:10:52.243924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2748f92c-5aaf-44df-b3d3-37e18fe282ad tempest-VolumesGetTest-363233367 None] Lock "b'cinder-4740bc11-bd9b-4cad-80cb-e170eb0dec56-delete_volume'" released by "delete_volume" :: held 0.556s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:11:10.105612 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:11:10.106360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:10.141732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:10.183415 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:11:37.365779 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6dd060b0-9925-420f-8d26-fa795f898c22 tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-1359311728: creating Nov 06 21:11:37.388649 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6dd060b0-9925-420f-8d26-fa795f898c22 tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-1359311728: created successfully Nov 06 21:11:37.409863 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6dd060b0-9925-420f-8d26-fa795f898c22 tempest-GroupSnapshotsTest-449826931 None] Create group completed successfully. Nov 06 21:11:39.302367 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:11:39.310128 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:11:39.310575 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:11:39.344511 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (30e440a7-d242-4a3a-a358-2318e0a937a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:39.357671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196a1554-ac8d-4f0f-9c2b-8e5d91cf5049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.377294 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:11:39.401306 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196a1554-ac8d-4f0f-9c2b-8e5d91cf5049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1696000447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bab301c1-b33a-4342-8cb8-945ad7c3d94e,host='ncdv-master-1@ceph#ceph',id=5785b15a-884c-4709-b67a-34b56bd7d57b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a9c233dbfe46b9bec48d56727ff3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:11:39Z,use_quota=True,user_id='a0ed2465572b4891a4e243ed00071693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4729aa49-1618-457d-8da8-bb2a9ea31fe9),volume_type_id=4729aa49-1618-457d-8da8-bb2a9ea31fe9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.404836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a4ed77-715a-4731-b515-a16a590dfd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.407444 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91a4ed77-715a-4731-b515-a16a590dfd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.410155 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1c39a8-c64c-44e5-9166-356db27e0786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.412811 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e1c39a8-c64c-44e5-9166-356db27e0786) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5785b15a-884c-4709-b67a-34b56bd7d57b', 'volume_name': 'volume-5785b15a-884c-4709-b67a-34b56bd7d57b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.419487 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b012d3-d55b-43d0-9d51-d5fc80634c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.422139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19b012d3-d55b-43d0-9d51-d5fc80634c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.432502 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1154809-42af-4308-9703-6bb6ead0d839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.452282 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Volume 5785b15a-884c-4709-b67a-34b56bd7d57b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5785b15a-884c-4709-b67a-34b56bd7d57b', 'volume_size': 1} Nov 06 21:11:39.452907 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] creating volume 'volume-5785b15a-884c-4709-b67a-34b56bd7d57b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:11:39.454121 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:39.593293 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:11:39.594021 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:11:39.616178 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1154809-42af-4308-9703-6bb6ead0d839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5785b15a-884c-4709-b67a-34b56bd7d57b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.626519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e67ac40-9302-4ae3-8f19-8f1f67fe6c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:39.693790 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Volume volume-5785b15a-884c-4709-b67a-34b56bd7d57b (5785b15a-884c-4709-b67a-34b56bd7d57b): created successfully Nov 06 21:11:39.714596 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e67ac40-9302-4ae3-8f19-8f1f67fe6c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:39.726661 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (30e440a7-d242-4a3a-a358-2318e0a937a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:39.755821 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9825b743-703f-4d45-b758-84bad938e5e3 tempest-GroupSnapshotsTest-449826931 None] Created volume successfully. Nov 06 21:11:40.581043 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 req-505778e8-de07-4fe8-ad2f-e61a31e4d429 tempest-AttachVolumeTestJSON-2096905218 None] Terminate volume connection completed successfully. Nov 06 21:11:40.583551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-f92be494-7cc5-4a5f-a218-b0d64d6896b1 req-505778e8-de07-4fe8-ad2f-e61a31e4d429 tempest-AttachVolumeTestJSON-2096905218 None] Deleting attachment e26e8967-7ff0-4f35-9ed4-8ff169fef4d6. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:11:40.735441 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-61889d8b-7f0d-42b5-b10e-d9ea274ab9b7 tempest-GroupSnapshotsTest-449826931 None] GroupSnapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: creating. Nov 06 21:11:40.790789 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-61889d8b-7f0d-42b5-b10e-d9ea274ab9b7 tempest-GroupSnapshotsTest-449826931 None] Group snapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: creating. {{(pid=127482) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 06 21:11:40.895993 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-61889d8b-7f0d-42b5-b10e-d9ea274ab9b7 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:42.227586 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-61889d8b-7f0d-42b5-b10e-d9ea274ab9b7 tempest-GroupSnapshotsTest-449826931 None] group_snapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: created successfully Nov 06 21:11:44.001444 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] cloning volumes/volume-5785b15a-884c-4709-b67a-34b56bd7d57b@snapshot-e60ebd08-f776-4fe5-a10a-e7e845af0119 to volume-5e539278-f962-4dd3-9301-e62c6fc655b1 {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:11:44.002077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:44.101307 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:44.339111 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:11:44.339941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:11:44.352113 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:44.417679 ncdv-master-1 cinder-volume[127482]: WARNING cinder.volume.drivers.rbd [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] Not using v2 clone API, please upgrade to mimic+ and set the OSD minimum client compat version to mimic for better performance, fewer deletion issues: NotImplementedError Nov 06 21:11:44.533158 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7ec705b5-4aec-48e0-97c1-c62fcf74c4b4 tempest-GroupSnapshotsTest-449826931 None] Create group from source-snapshot-6d27ca05-2b79-4fe5-b7e8-6c6611a147ec completed successfully. Nov 06 21:11:45.721226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:45.849328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:11:45.864341 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] deleting rbd volume volume-5e539278-f962-4dd3-9301-e62c6fc655b1 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:11:46.256254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Created reservations ['d9345224-5f49-4a36-b962-058101454e5a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:11:46.277255 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-606513188 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-606513188, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:11:46.278261 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-606513188 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-606513188, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:11:46.299334 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Created reservations ['ecae35ea-8a34-43c6-b623-a1127b8356a5', '2f9fec07-c34d-4c45-8652-d1f3035106fa', '2b8c2cd1-3eba-4282-aecf-2df3e1541f70', 'bf18c98d-42ba-4540-8c21-e13f959f190a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:11:46.386459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:46.422436 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:46.478432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:11:46.482566 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d2dae31d-5d1c-4728-bbea-2a0c687d75eb tempest-GroupSnapshotsTest-449826931 None] Delete group completed successfully. Nov 06 21:11:46.904193 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] group_snapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: deleting Nov 06 21:11:46.920957 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] group_snapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: deleting {{(pid=127482) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 06 21:11:46.937212 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:48.044154 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-606513188 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-606513188, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:11:48.070471 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] Created reservations ['90f6bd80-562d-4dc7-a4b5-af3aaf9c4b2b', '5be5336d-2f53-4c77-aa77-f5c46757fc3f', '1a01c1a3-56cb-468c-9b42-98ec6486640f', '70fc3c03-36f2-425a-9c91-95cfcd35b0a8'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:11:48.191717 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8f7caaf7-8b9f-4c0c-b1fe-273091cbc90e tempest-GroupSnapshotsTest-449826931 None] group_snapshot 6d27ca05-2b79-4fe5-b7e8-6c6611a147ec: deleted successfully Nov 06 21:11:49.442863 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:49.545911 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:11:49.546721 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Volume volume-5785b15a-884c-4709-b67a-34b56bd7d57b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:11:49.558384 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] deleting rbd volume volume-5785b15a-884c-4709-b67a-34b56bd7d57b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:11:49.962697 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Created reservations ['3a22b170-4b85-42aa-9516-0a0d3f95e97f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:11:49.994140 ncdv-master-1 cinder-volume[127482]: WARNING cinder.db.sqlalchemy.api [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-606513188'] Nov 06 21:11:49.999718 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Created reservations ['ec84b2b7-d587-4ae1-be70-a4265784a1e6', '5b6a1372-888d-45ca-8c92-2f83f2b038a3', '926a2002-b9e9-42ba-849f-084c6c4ac4f9', '3ee11a4b-5877-4b2d-9f37-cfe996430d90'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:11:50.128033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:50.171348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:50.230674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:11:50.237508 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-eaed3e7b-131d-48be-8359-a8e8010c2bb7 tempest-GroupSnapshotsTest-449826931 None] Delete group completed successfully. Nov 06 21:11:50.971738 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b12e0ef7-de83-4caf-8285-db19d5a7e56b tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-1313170012: creating Nov 06 21:11:50.999543 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b12e0ef7-de83-4caf-8285-db19d5a7e56b tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-1313170012: created successfully Nov 06 21:11:51.011591 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b12e0ef7-de83-4caf-8285-db19d5a7e56b tempest-GroupSnapshotsTest-449826931 None] Create group completed successfully. Nov 06 21:11:52.972569 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:11:52.978103 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:11:52.978878 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:11:52.993425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (911b5306-0f67-4b91-907f-5c8a492a6099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:52.996864 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4100783e-4f70-47c7-a952-6227c832fd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.003448 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:11:53.016894 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4100783e-4f70-47c7-a952-6227c832fd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1908661266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34228c07-0c73-4746-9afe-527d688a0ebf,host='ncdv-master-1@ceph#ceph',id=9b70027d-8c55-4420-a35d-e77edae74838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a9c233dbfe46b9bec48d56727ff3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:11:53Z,use_quota=True,user_id='a0ed2465572b4891a4e243ed00071693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7538989a-2ddb-4e04-ae9e-72f20e18783d),volume_type_id=7538989a-2ddb-4e04-ae9e-72f20e18783d)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.019640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304d3a2b-de58-4d49-8f15-5735d922f0c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.022477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (304d3a2b-de58-4d49-8f15-5735d922f0c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.025404 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1f1fe-6712-4b09-b061-d98f6643f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.028026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bc1f1fe-6712-4b09-b061-d98f6643f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b70027d-8c55-4420-a35d-e77edae74838', 'volume_name': 'volume-9b70027d-8c55-4420-a35d-e77edae74838', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.031157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c99aa-afe6-47f4-b9a3-9a69db010481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.034127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f19c99aa-afe6-47f4-b9a3-9a69db010481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.038277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f0b373-9fbd-4a17-93da-16944783255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.055207 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Volume 9b70027d-8c55-4420-a35d-e77edae74838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b70027d-8c55-4420-a35d-e77edae74838', 'volume_size': 1} Nov 06 21:11:53.055980 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] creating volume 'volume-9b70027d-8c55-4420-a35d-e77edae74838' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:11:53.057291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:53.152831 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:11:53.154328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:11:53.157987 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16f0b373-9fbd-4a17-93da-16944783255f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b70027d-8c55-4420-a35d-e77edae74838', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.161012 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4effaa74-f17a-411d-8df3-5017a5aca17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:53.174275 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Volume volume-9b70027d-8c55-4420-a35d-e77edae74838 (9b70027d-8c55-4420-a35d-e77edae74838): created successfully Nov 06 21:11:53.177152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4effaa74-f17a-411d-8df3-5017a5aca17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:53.180804 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (911b5306-0f67-4b91-907f-5c8a492a6099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:53.193104 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b740eaf2-1e75-41d2-8186-686a11720db3 tempest-GroupSnapshotsTest-449826931 None] Created volume successfully. Nov 06 21:11:54.614294 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:11:54.619685 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:11:54.620610 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:11:54.636145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (b017eeb5-0cd2-41f0-b300-4b36ca77e43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:54.640059 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c9decd-5d43-43db-af32-3e88e3823765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.648720 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:11:54.681319 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c9decd-5d43-43db-af32-3e88e3823765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:11:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1488329599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34228c07-0c73-4746-9afe-527d688a0ebf,host='ncdv-master-1@ceph#ceph',id=421ae8ec-083e-447e-9e0e-36316faa00ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a9c233dbfe46b9bec48d56727ff3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:11:55Z,use_quota=True,user_id='a0ed2465572b4891a4e243ed00071693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7538989a-2ddb-4e04-ae9e-72f20e18783d),volume_type_id=7538989a-2ddb-4e04-ae9e-72f20e18783d)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.684150 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699f844e-8b8f-4882-9b2f-8afbe6b1fa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.686315 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (699f844e-8b8f-4882-9b2f-8afbe6b1fa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.688733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d4d432-4738-4ffd-a229-65443095f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.703104 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d4d432-4738-4ffd-a229-65443095f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '421ae8ec-083e-447e-9e0e-36316faa00ee', 'volume_name': 'volume-421ae8ec-083e-447e-9e0e-36316faa00ee', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.706908 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4b4ba3-7dd9-42fa-9bb0-dda20280a848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.728014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d4b4ba3-7dd9-42fa-9bb0-dda20280a848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.735685 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd76d48-bbe2-441e-8928-bdfa298bdd29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.760928 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Volume 421ae8ec-083e-447e-9e0e-36316faa00ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-421ae8ec-083e-447e-9e0e-36316faa00ee', 'volume_size': 1} Nov 06 21:11:54.761674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] creating volume 'volume-421ae8ec-083e-447e-9e0e-36316faa00ee' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:11:54.763189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:11:54.872813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:11:54.873243 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:11:54.875328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bd76d48-bbe2-441e-8928-bdfa298bdd29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-421ae8ec-083e-447e-9e0e-36316faa00ee', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.881810 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14434a7-81e5-4114-a959-e74dc6b01382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:11:54.895052 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Volume volume-421ae8ec-083e-447e-9e0e-36316faa00ee (421ae8ec-083e-447e-9e0e-36316faa00ee): created successfully Nov 06 21:11:54.897540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e14434a7-81e5-4114-a959-e74dc6b01382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:11:54.904564 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (b017eeb5-0cd2-41f0-b300-4b36ca77e43d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:11:54.919323 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7684a879-a967-43ae-b1d6-bd966c04dcd3 tempest-GroupSnapshotsTest-449826931 None] Created volume successfully. Nov 06 21:11:55.871267 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ae68fa1d-944b-453d-912b-1f7e466d59a8 tempest-GroupSnapshotsTest-449826931 None] Update group completed successfully. Nov 06 21:11:57.009563 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4c8c7bd7-395c-478a-955b-103a6e08e33d tempest-GroupSnapshotsTest-449826931 None] Update group completed successfully. Nov 06 21:11:58.153549 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2da82976-673d-43dd-a8a8-8c46c9837a24 tempest-GroupSnapshotsTest-449826931 None] Update group completed successfully. Nov 06 21:11:59.388249 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5e511a2e-a795-43d7-9640-31fdf8b8b6d1 tempest-GroupSnapshotsTest-449826931 None] Update group completed successfully. Nov 06 21:12:00.873970 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-81eef3e4-0445-4bfa-8314-440ad4549a04 tempest-GroupSnapshotsTest-449826931 None] GroupSnapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: creating. Nov 06 21:12:00.903223 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-81eef3e4-0445-4bfa-8314-440ad4549a04 tempest-GroupSnapshotsTest-449826931 None] Group snapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: creating. {{(pid=127482) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 06 21:12:00.936131 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-81eef3e4-0445-4bfa-8314-440ad4549a04 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:01.917551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-81eef3e4-0445-4bfa-8314-440ad4549a04 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:03.023707 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-81eef3e4-0445-4bfa-8314-440ad4549a04 tempest-GroupSnapshotsTest-449826931 None] group_snapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: created successfully Nov 06 21:12:03.194869 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] group_snapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: deleting Nov 06 21:12:03.234854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] group_snapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: deleting {{(pid=127482) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 06 21:12:03.263893 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:04.487644 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:05.529851 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1905415785 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1905415785, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:05.531326 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1905415785 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1905415785, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:05.553909 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] Created reservations ['effb2368-c81b-414c-aa27-5788fcca2c4e', 'd5b487f3-567f-4735-82bf-99b97b40fe9e', '4d6a80b3-cf9f-4b1b-a7c1-c5093751c000', '79d5ff09-188e-4340-a134-f2bb55ecba6b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:05.685900 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] Created reservations ['e3519a9f-3a7b-4c4f-800f-59d0f8507082', 'f81e0eba-b7d2-491d-8dd1-0685e79d1153', '7641fb0c-5341-4071-9de4-e76ce9d681da', '4ed5da51-1d7f-49b1-9c7b-dd3d7b589cf0'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:05.768232 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2a0e1ae6-a274-4865-85b9-65f575ff5ccc tempest-GroupSnapshotsTest-449826931 None] group_snapshot 36f0f50a-f3fa-444d-8c8a-8b0fda4d8d8d: deleted successfully Nov 06 21:12:07.030080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:07.103556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:12:07.104239 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Volume volume-421ae8ec-083e-447e-9e0e-36316faa00ee is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:12:07.114547 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] deleting rbd volume volume-421ae8ec-083e-447e-9e0e-36316faa00ee {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:12:07.476006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:07.590179 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:12:07.591768 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Volume volume-9b70027d-8c55-4420-a35d-e77edae74838 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:12:07.602326 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] deleting rbd volume volume-9b70027d-8c55-4420-a35d-e77edae74838 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:12:08.026729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Created reservations ['5c546f3e-c79e-41c3-aa58-b667e3289a6c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:08.054028 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1905415785 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1905415785, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:08.075249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Created reservations ['262abe4d-e869-4cd7-93f2-101e641bed43', '289fb710-adbc-47f8-ba3c-5ebe6f4da9b6', '8697b510-d9a1-4831-9d7c-694089239597', '4f9d0bb1-4f77-4e10-9698-49a7fcdc3772'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:08.223898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Created reservations ['b825b638-2532-4505-8800-2523b7759ce0', '8e019421-8d66-4b8f-a826-1dbd05260444', 'c6a84e99-1990-4205-93c4-8003f5bd3369', '13e97b6b-da0c-44dc-b4af-9074baa5d97b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:08.351515 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:08.414455 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:08.478913 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:12:08.485960 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4756ab96-a24f-483f-bacb-9944a3c301ae tempest-GroupSnapshotsTest-449826931 None] Delete group completed successfully. Nov 06 21:12:09.655049 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4d881034-64f8-44a5-a301-cd4de4a589ea tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-255869272: creating Nov 06 21:12:09.692269 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4d881034-64f8-44a5-a301-cd4de4a589ea tempest-GroupSnapshotsTest-449826931 None] Group tempest-GroupSnapshotsTest-Group-255869272: created successfully Nov 06 21:12:09.702160 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4d881034-64f8-44a5-a301-cd4de4a589ea tempest-GroupSnapshotsTest-449826931 None] Create group completed successfully. Nov 06 21:12:10.114223 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:12:10.115083 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:10.164165 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:10.214748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:12:11.084399 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:12:11.087638 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:12:11.088080 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:12:11.120762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (29906db7-1884-4340-99ce-bd3f8455318b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:11.123739 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083f9677-f481-4d3e-8754-f01ea53eb281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.130434 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:12:11.142500 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (083f9677-f481-4d3e-8754-f01ea53eb281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:12:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupSnapshotsTest-Volume-1358239536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6522062d-19a1-47eb-9d1c-fb7b7a9d72ae,host='ncdv-master-1@ceph#ceph',id=9516c2da-5167-4e4b-8080-a13aeaab8fc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53a9c233dbfe46b9bec48d56727ff3db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:12:11Z,use_quota=True,user_id='a0ed2465572b4891a4e243ed00071693',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aab1662c-367e-444e-a39a-bab17e0e4655),volume_type_id=aab1662c-367e-444e-a39a-bab17e0e4655)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.145473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6394fd-e266-4ddc-bd48-a83f6d9af031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.147503 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6394fd-e266-4ddc-bd48-a83f6d9af031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.149795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319de968-c6e2-4a04-b10c-de3c33e9ae8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.152223 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (319de968-c6e2-4a04-b10c-de3c33e9ae8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9516c2da-5167-4e4b-8080-a13aeaab8fc6', 'volume_name': 'volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.154680 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20040e4f-5a13-4d25-891c-a13fdd777bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.158785 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20040e4f-5a13-4d25-891c-a13fdd777bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.162173 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbabedd-a5b5-4362-95fb-9ddc44bd3b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.177004 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Volume 9516c2da-5167-4e4b-8080-a13aeaab8fc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6', 'volume_size': 1} Nov 06 21:12:11.177407 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] creating volume 'volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:12:11.178408 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:11.234481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:12:11.234861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:12:11.236924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cbabedd-a5b5-4362-95fb-9ddc44bd3b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.239071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe7c649-84ff-4766-bdcc-5fb5f66f53fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:11.247735 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Volume volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6 (9516c2da-5167-4e4b-8080-a13aeaab8fc6): created successfully Nov 06 21:12:11.249854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfe7c649-84ff-4766-bdcc-5fb5f66f53fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:11.252753 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Flow 'volume_create_manager' (29906db7-1884-4340-99ce-bd3f8455318b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:11.261042 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-66894f0d-7727-443e-bae0-cd140ea1ee2d tempest-GroupSnapshotsTest-449826931 None] Created volume successfully. Nov 06 21:12:12.305563 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c199f2ce-d32d-4fea-84a4-0b4770c8dedc tempest-GroupSnapshotsTest-449826931 None] GroupSnapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: creating. Nov 06 21:12:12.320337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c199f2ce-d32d-4fea-84a4-0b4770c8dedc tempest-GroupSnapshotsTest-449826931 None] Group snapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: creating. {{(pid=127482) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4074}} Nov 06 21:12:12.341650 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c199f2ce-d32d-4fea-84a4-0b4770c8dedc tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:13.514548 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c199f2ce-d32d-4fea-84a4-0b4770c8dedc tempest-GroupSnapshotsTest-449826931 None] group_snapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: created successfully Nov 06 21:12:14.544838 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] group_snapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: deleting Nov 06 21:12:14.561508 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] group_snapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: deleting {{(pid=127482) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4249}} Nov 06 21:12:14.577450 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:15.475062 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1951602748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1951602748, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:15.475849 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1951602748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1951602748, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:15.490243 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] Created reservations ['f004756e-7768-4848-a8a1-bfdb8845c7ca', '4330a60f-f572-4e37-a7e4-457a3ee771ea', 'd6cb8d11-0ee9-42b1-bf27-c63478a61017', '15d1cbe2-58db-428c-886b-ceef71381cb3'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:15.530938 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d48d8c37-e57f-467a-8476-a78913e75e35 tempest-GroupSnapshotsTest-449826931 None] group_snapshot e54b9ce4-89fe-41ef-8b37-fafd1ca43d7f: deleted successfully Nov 06 21:12:15.976665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:16.031968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:12:16.032535 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Volume volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:12:16.041401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] deleting rbd volume volume-9516c2da-5167-4e4b-8080-a13aeaab8fc6 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:12:16.255654 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Created reservations ['26d2b360-06e5-4149-9a2c-e2d33cf541e4'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:16.274482 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1951602748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1951602748, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:12:16.290038 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Created reservations ['6e012993-b69e-4b63-b927-bf4d31fc1569', '97dc1bde-b452-4d83-8035-9ce25939171e', '15dbd0b9-83c1-4288-87e4-fff40015c4a7', '3a556b0a-8e16-48d6-af5b-c69aec0a08bd'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:16.365457 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:16.395553 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:16.428212 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:12:16.432457 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4035463d-d4e0-4f88-8f79-eb6bb5244cc5 tempest-GroupSnapshotsTest-449826931 None] Delete group completed successfully. Nov 06 21:12:34.914814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:12:34.918443 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:12:34.918884 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:12:34.930962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Flow 'volume_create_manager' (ef5d0c68-781a-4b86-8074-33db341d8d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:34.934348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7b21f0-6586-4197-ae66-3ed5a8295138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:34.940568 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:12:34.960634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7b21f0-6586-4197-ae66-3ed5a8295138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-150826587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=44bd2c4e-1655-43c6-83ca-c74d79ffa65f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301deb45ac9c45eab92b560b6b461e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:12:35Z,use_quota=True,user_id='41e6277005f9407b939f4d55e4e05ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:34.963332 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dd0719-e782-4024-a8a7-360d04979cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:34.965459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55dd0719-e782-4024-a8a7-360d04979cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:34.967839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b7f821-be58-410e-96cb-c030c6d49a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:34.970054 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b7f821-be58-410e-96cb-c030c6d49a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44bd2c4e-1655-43c6-83ca-c74d79ffa65f', 'volume_name': 'volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:34.972431 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55380569-3891-43b2-80e3-c0099aa69cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:34.975136 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55380569-3891-43b2-80e3-c0099aa69cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:34.977295 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a12199-2ee7-4e2f-bf08-77fbc1998289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:34.978059 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Volume 44bd2c4e-1655-43c6-83ca-c74d79ffa65f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f', 'volume_size': 1} Nov 06 21:12:34.978451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] creating volume 'volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:12:34.980056 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:35.063163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:12:35.063816 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:12:35.065967 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33a12199-2ee7-4e2f-bf08-77fbc1998289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:35.069651 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c166e53-5d14-4fd1-b576-6b0f418eeddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:35.083560 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Volume volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f (44bd2c4e-1655-43c6-83ca-c74d79ffa65f): created successfully Nov 06 21:12:35.085202 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c166e53-5d14-4fd1-b576-6b0f418eeddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:35.088279 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Flow 'volume_create_manager' (ef5d0c68-781a-4b86-8074-33db341d8d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:35.101168 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5ad0bc8e-8334-46fc-b818-2c6c08c0e51a tempest-VolumesTransfersV355Test-1449052757 None] Created volume successfully. Nov 06 21:12:36.575955 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-dd1262c7-4f7e-4928-8945-563688a795c7 tempest-VolumesTransfersV355Test-6200578 None] Transfer volume completed successfully. Nov 06 21:12:36.994290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Lock "b'cinder-44bd2c4e-1655-43c6-83ca-c74d79ffa65f-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:12:37.028783 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:37.085244 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:12:37.085715 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Volume volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:12:37.096410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] deleting rbd volume volume-44bd2c4e-1655-43c6-83ca-c74d79ffa65f {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:12:37.391171 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Created reservations ['90956eb7-1fcc-4a18-937a-11f3d7b56100', 'ba3c3259-b8cf-4769-b553-a8ff4752dcad', 'd7fed934-3836-499f-8443-08e5458c9ef3', 'b7e9596a-7b29-4a23-ab3e-060130c5bc7d'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:37.444657 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:37.501705 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:37.557378 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:12:37.563499 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Deleted volume successfully. Nov 06 21:12:37.577991 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a61e383c-ed8d-4564-9d38-403544afcd72 tempest-VolumesTransfersV355Test-1559963703 None] Lock "b'cinder-44bd2c4e-1655-43c6-83ca-c74d79ffa65f-delete_volume'" released by "delete_volume" :: held 0.584s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:12:38.540270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:12:38.551226 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:12:38.551691 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:12:38.564944 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Flow 'volume_create_manager' (dfbedf22-0568-45ed-96cc-34c8caa9a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:38.568605 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19136ef-55f2-457b-ae69-fa19212aec3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.575909 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:12:38.590139 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e19136ef-55f2-457b-ae69-fa19212aec3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:12:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-129430497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=19e7fbd9-4cbe-4440-964b-41da197d6e05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301deb45ac9c45eab92b560b6b461e70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:12:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:12:38Z,use_quota=True,user_id='41e6277005f9407b939f4d55e4e05ce9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.592683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da072ca5-e2c6-440a-b743-2fd16aeaa846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.595070 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da072ca5-e2c6-440a-b743-2fd16aeaa846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.597952 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c04544-20d6-4a0b-b1ad-ddf10016a3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.600328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c04544-20d6-4a0b-b1ad-ddf10016a3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e7fbd9-4cbe-4440-964b-41da197d6e05', 'volume_name': 'volume-19e7fbd9-4cbe-4440-964b-41da197d6e05', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.602745 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bae686d-18a9-4fa1-a95d-e27c9fe0db56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.605010 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bae686d-18a9-4fa1-a95d-e27c9fe0db56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.607112 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55486a6c-8ef3-4ca2-92e0-b40bf7f47625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.607870 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Volume 19e7fbd9-4cbe-4440-964b-41da197d6e05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e7fbd9-4cbe-4440-964b-41da197d6e05', 'volume_size': 1} Nov 06 21:12:38.608252 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] creating volume 'volume-19e7fbd9-4cbe-4440-964b-41da197d6e05' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:12:38.609508 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:38.694220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:12:38.694654 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:12:38.696877 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55486a6c-8ef3-4ca2-92e0-b40bf7f47625) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e7fbd9-4cbe-4440-964b-41da197d6e05', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.698997 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b10e93-ebc2-4810-bf99-56e479077bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:12:38.708287 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Volume volume-19e7fbd9-4cbe-4440-964b-41da197d6e05 (19e7fbd9-4cbe-4440-964b-41da197d6e05): created successfully Nov 06 21:12:38.711110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92b10e93-ebc2-4810-bf99-56e479077bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:12:38.714261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Flow 'volume_create_manager' (dfbedf22-0568-45ed-96cc-34c8caa9a056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:12:38.724256 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-98867014-57e7-4e51-9642-832e959cd9fb tempest-VolumesTransfersV355Test-1449052757 None] Created volume successfully. Nov 06 21:12:39.895853 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Lock "b'cinder-19e7fbd9-4cbe-4440-964b-41da197d6e05-delete_volume'" acquired by "delete_volume" :: waited 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:12:39.924161 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:39.979195 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:12:39.979735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Volume volume-19e7fbd9-4cbe-4440-964b-41da197d6e05 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:12:39.985657 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] deleting rbd volume volume-19e7fbd9-4cbe-4440-964b-41da197d6e05 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:12:40.286577 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Created reservations ['2d4ea9c1-eb21-4156-a2a2-20baf1eee587', '4fdbd8d4-9b70-4237-83d3-368d2ceaaad5', 'd80d47de-cfaf-43b6-b1ed-5ca6e86cb957', 'd26c3859-d2a7-4348-a6e6-faf04cd6ac38'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:12:40.339454 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:40.378316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:12:40.424503 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:12:40.433189 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Deleted volume successfully. Nov 06 21:12:40.448210 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d11d3838-25b8-4976-9043-3715bc58a82e tempest-VolumesTransfersV355Test-1559963703 None] Lock "b'cinder-19e7fbd9-4cbe-4440-964b-41da197d6e05-delete_volume'" released by "delete_volume" :: held 0.552s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:13:10.111220 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:13:10.113249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:10.237665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:10.317324 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:13:17.638238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:13:17.644541 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:13:17.649990 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:17.673202 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (a67d1014-3c04-43d8-8f81-9214c23965b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:17.677067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4382be4-3de6-4e25-8cc5-2bec6966ec2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:17.683838 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:13:17.699366 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4382be4-3de6-4e25-8cc5-2bec6966ec2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1432362048',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=26bcd7cd-d641-407f-9d6e-463c54fc3025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091e07dbaca4b439d38b56488c3048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:13:18Z,use_quota=True,user_id='8ba94a4d3b5f43c1991b1c155b3c2853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:17.718666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda32dbd-9ba0-4b5a-94b6-87a6c52ba151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:17.720838 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cda32dbd-9ba0-4b5a-94b6-87a6c52ba151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:17.728893 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343ba7e8-b468-450a-820e-eadd0148252c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:17.851371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (343ba7e8-b468-450a-820e-eadd0148252c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '26bcd7cd-d641-407f-9d6e-463c54fc3025', 'volume_name': 'volume-26bcd7cd-d641-407f-9d6e-463c54fc3025', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:17.854089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f44655-88d5-4e7c-ae1e-3b53649f391b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:17.856383 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f44655-88d5-4e7c-ae1e-3b53649f391b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:17.858492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a212727-7f24-4c26-bc62-d39786122470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:17.859272 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Volume 26bcd7cd-d641-407f-9d6e-463c54fc3025: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-26bcd7cd-d641-407f-9d6e-463c54fc3025', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:13:17.859833 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Cloning 26bcd7cd-d641-407f-9d6e-463c54fc3025 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:13:17.870271 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:13:17.882639 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 13, 17, 876904)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:13:17.883166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:13:17.883607 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:13:17.888567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.018s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:13:17.890053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:13:17.896019 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 13, 17, 893662)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:13:17.896537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:13:17.896942 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:13:17.908902 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:17.966478 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] creating snapshot='volume-26bcd7cd-d641-407f-9d6e-463c54fc3025.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:13:18.824635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-26bcd7cd-d641-407f-9d6e-463c54fc3025.clone_snap' to 'volume-26bcd7cd-d641-407f-9d6e-463c54fc3025' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:13:18.992225 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:13:18.997483 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:13:18.997904 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:13:19.012879 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:13:19.013470 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Marking volume 26bcd7cd-d641-407f-9d6e-463c54fc3025 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:13:19.021217 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 26bcd7cd-d641-407f-9d6e-463c54fc3025. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:13:19.021631 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Creating volume glance metadata for volume 26bcd7cd-d641-407f-9d6e-463c54fc3025 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:13:19.066995 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a212727-7f24-4c26-bc62-d39786122470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26bcd7cd-d641-407f-9d6e-463c54fc3025', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:19.069121 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f33e546-ef65-4e04-86ad-03faf7642180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:19.076033 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-26bcd7cd-d641-407f-9d6e-463c54fc3025 (26bcd7cd-d641-407f-9d6e-463c54fc3025): created successfully Nov 06 21:13:19.077798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f33e546-ef65-4e04-86ad-03faf7642180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:19.081114 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (a67d1014-3c04-43d8-8f81-9214c23965b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:19.088239 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e87d0cb2-60a5-4e2e-91d7-8d2a946c5692 tempest-TaggedBootDevicesTest-1306124712 None] Created volume successfully. Nov 06 21:13:20.010961 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:13:20.015625 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:13:20.016193 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:20.034928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (aa3b0e88-3520-4827-ae84-633c9a64eca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:20.038100 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49550a35-c115-416f-b4f3-60b04d790f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.045629 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:13:20.063513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49550a35-c115-416f-b4f3-60b04d790f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:13:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-915710895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4e056961-b9e2-465b-b784-f4012c5e4f43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091e07dbaca4b439d38b56488c3048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:13:20Z,use_quota=True,user_id='8ba94a4d3b5f43c1991b1c155b3c2853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.066226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec37933-467e-46f0-9358-869e1a52bdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.068513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ec37933-467e-46f0-9358-869e1a52bdb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.071071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda4108-7343-46c9-955a-ccc1cbed88c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.073440 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda4108-7343-46c9-955a-ccc1cbed88c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e056961-b9e2-465b-b784-f4012c5e4f43', 'volume_name': 'volume-4e056961-b9e2-465b-b784-f4012c5e4f43', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.075734 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0a91f-806a-4daf-9211-d1287d0dd548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.078055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0a91f-806a-4daf-9211-d1287d0dd548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.080892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a06ed31-044a-497a-bee8-6e16a3e716ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.081730 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Volume 4e056961-b9e2-465b-b784-f4012c5e4f43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e056961-b9e2-465b-b784-f4012c5e4f43', 'volume_size': 1} Nov 06 21:13:20.082190 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] creating volume 'volume-4e056961-b9e2-465b-b784-f4012c5e4f43' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:13:20.083392 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:20.206677 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:13:20.207050 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:13:20.209998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a06ed31-044a-497a-bee8-6e16a3e716ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e056961-b9e2-465b-b784-f4012c5e4f43', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.212365 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d163ee-4ec5-47e7-901a-f2776b9e386d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:20.224624 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-4e056961-b9e2-465b-b784-f4012c5e4f43 (4e056961-b9e2-465b-b784-f4012c5e4f43): created successfully Nov 06 21:13:20.226495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91d163ee-4ec5-47e7-901a-f2776b9e386d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:20.229516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (aa3b0e88-3520-4827-ae84-633c9a64eca9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:20.237835 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1afd0c31-0aa1-408d-bbd1-6c91085105e8 tempest-TaggedBootDevicesTest-1306124712 None] Created volume successfully. Nov 06 21:13:21.339545 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:13:21.344207 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:13:21.344692 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:21.356926 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (118eb9d1-2141-4802-a47e-ad8a304232f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:21.360664 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478f5cef-4aee-45ca-881e-36ee42878adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.367367 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:13:21.382164 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (478f5cef-4aee-45ca-881e-36ee42878adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1584179152',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=4422ae34-1eb5-41ba-9b68-f992e04d069f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2091e07dbaca4b439d38b56488c3048f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:13:21Z,use_quota=True,user_id='8ba94a4d3b5f43c1991b1c155b3c2853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.384688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec87041-4986-4628-ad59-eed1551f0107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.386759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eec87041-4986-4628-ad59-eed1551f0107) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.389101 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cc47c9-cc07-463a-821a-7a9147a8d05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.391261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99cc47c9-cc07-463a-821a-7a9147a8d05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4422ae34-1eb5-41ba-9b68-f992e04d069f', 'volume_name': 'volume-4422ae34-1eb5-41ba-9b68-f992e04d069f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.393520 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8629bfc-b1bd-4127-8a1f-124a7c044fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.395567 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8629bfc-b1bd-4127-8a1f-124a7c044fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.397798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ede12-afd5-4fe9-9461-3557f8a73cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.399171 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Volume 4422ae34-1eb5-41ba-9b68-f992e04d069f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4422ae34-1eb5-41ba-9b68-f992e04d069f', 'volume_size': 1} Nov 06 21:13:21.399749 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] creating volume 'volume-4422ae34-1eb5-41ba-9b68-f992e04d069f' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:13:21.400793 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:21.483618 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:13:21.484127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:13:21.486207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8ede12-afd5-4fe9-9461-3557f8a73cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4422ae34-1eb5-41ba-9b68-f992e04d069f', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.489004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83f81eb-45bb-42ec-a59f-c5e3a7addd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:21.501645 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-4422ae34-1eb5-41ba-9b68-f992e04d069f (4422ae34-1eb5-41ba-9b68-f992e04d069f): created successfully Nov 06 21:13:21.504095 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83f81eb-45bb-42ec-a59f-c5e3a7addd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:21.507046 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Flow 'volume_create_manager' (118eb9d1-2141-4802-a47e-ad8a304232f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:21.515812 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-39c82bd7-000f-46a8-9833-534d16c513b6 tempest-TaggedBootDevicesTest-1306124712 None] Created volume successfully. Nov 06 21:13:33.234665 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-64e496a4-76dd-4764-a1bc-9e8d2e5cf24f tempest-TaggedBootDevicesTest-1306124712 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:13:33.900197 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-64e496a4-76dd-4764-a1bc-9e8d2e5cf24f tempest-TaggedBootDevicesTest-1306124712 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.666s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:13:33.901044 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-64e496a4-76dd-4764-a1bc-9e8d2e5cf24f tempest-TaggedBootDevicesTest-1306124712 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-26bcd7cd-d641-407f-9d6e-463c54fc3025', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '26bcd7cd-d641-407f-9d6e-463c54fc3025', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:13:33.925273 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-64e496a4-76dd-4764-a1bc-9e8d2e5cf24f tempest-TaggedBootDevicesTest-1306124712 None] Connection info returned from driver {'name': 'volumes/volume-26bcd7cd-d641-407f-9d6e-463c54fc3025', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '26bcd7cd-d641-407f-9d6e-463c54fc3025', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '777569a5-a009-4a34-9802-0c0d13dced6b'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:13:33.984848 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-64e496a4-76dd-4764-a1bc-9e8d2e5cf24f tempest-TaggedBootDevicesTest-1306124712 None] attachment_update completed successfully. Nov 06 21:13:34.346346 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-5f14644d-63e6-47a6-b406-53a154ee6159 tempest-TaggedBootDevicesTest-1306124712 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:13:35.070952 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-5f14644d-63e6-47a6-b406-53a154ee6159 tempest-TaggedBootDevicesTest-1306124712 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.725s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:13:35.071864 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-5f14644d-63e6-47a6-b406-53a154ee6159 tempest-TaggedBootDevicesTest-1306124712 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4e056961-b9e2-465b-b784-f4012c5e4f43', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '4e056961-b9e2-465b-b784-f4012c5e4f43', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:13:35.098338 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-5f14644d-63e6-47a6-b406-53a154ee6159 tempest-TaggedBootDevicesTest-1306124712 None] Connection info returned from driver {'name': 'volumes/volume-4e056961-b9e2-465b-b784-f4012c5e4f43', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4e056961-b9e2-465b-b784-f4012c5e4f43', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'df70bc7f-a504-4ab9-817b-b194ee5299d0'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:13:35.156810 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-5f14644d-63e6-47a6-b406-53a154ee6159 tempest-TaggedBootDevicesTest-1306124712 None] attachment_update completed successfully. Nov 06 21:13:35.508597 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-fdf94360-6392-495c-8870-7c7a7da3248e tempest-TaggedBootDevicesTest-1306124712 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:13:36.223692 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-fdf94360-6392-495c-8870-7c7a7da3248e tempest-TaggedBootDevicesTest-1306124712 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.715s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:13:36.224681 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-fdf94360-6392-495c-8870-7c7a7da3248e tempest-TaggedBootDevicesTest-1306124712 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-4422ae34-1eb5-41ba-9b68-f992e04d069f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '4422ae34-1eb5-41ba-9b68-f992e04d069f', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:13:36.254575 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-fdf94360-6392-495c-8870-7c7a7da3248e tempest-TaggedBootDevicesTest-1306124712 None] Connection info returned from driver {'name': 'volumes/volume-4422ae34-1eb5-41ba-9b68-f992e04d069f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '4422ae34-1eb5-41ba-9b68-f992e04d069f', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ac4f01c5-fceb-4724-bc33-5e852a1b9836'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:13:36.324308 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a23fb42b-52cb-4c47-8975-d4b32e370507 req-fdf94360-6392-495c-8870-7c7a7da3248e tempest-TaggedBootDevicesTest-1306124712 None] attachment_update completed successfully. Nov 06 21:13:58.265275 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:13:58.270499 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:13:58.271061 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:13:58.287677 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (88c9d927-c5d5-4929-9991-88239baa63b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:58.291356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21494b83-0a40-4c59-9e86-f116e95c858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:58.298977 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:13:58.312516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21494b83-0a40-4c59-9e86-f116e95c858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1634731428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=208dee27-a2bc-4eee-a947-a2a06469a986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:13:58Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:58.315926 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf8fe97-e775-46ea-835c-75920adfba7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:58.318894 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cf8fe97-e775-46ea-835c-75920adfba7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:58.321399 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9aed44-006a-4c8d-a135-10a8a3c6c1e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:58.419758 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db9aed44-006a-4c8d-a135-10a8a3c6c1e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '208dee27-a2bc-4eee-a947-a2a06469a986', 'volume_name': 'volume-208dee27-a2bc-4eee-a947-a2a06469a986', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:58.422848 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a8a518-8590-4656-984a-34ad20388647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:58.425191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25a8a518-8590-4656-984a-34ad20388647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:58.427626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ad0294-3d5a-4228-8ea4-2f0d88ff9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:58.428657 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Volume 208dee27-a2bc-4eee-a947-a2a06469a986: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-208dee27-a2bc-4eee-a947-a2a06469a986', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:13:58.429400 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Cloning 208dee27-a2bc-4eee-a947-a2a06469a986 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:13:58.441879 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:13:58.454729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 13, 58, 446927)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:13:58.455277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:13:58.456008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:13:58.462372 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.021s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:13:58.463300 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:13:58.469057 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 13, 58, 466689)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:13:58.470089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:13:58.470482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:13:58.482504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:58.553591 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] creating snapshot='volume-208dee27-a2bc-4eee-a947-a2a06469a986.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:13:58.862347 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-208dee27-a2bc-4eee-a947-a2a06469a986.clone_snap' to 'volume-208dee27-a2bc-4eee-a947-a2a06469a986' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:13:59.074781 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:13:59.082104 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:13:59.082507 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:13:59.100668 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:13:59.101384 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Marking volume 208dee27-a2bc-4eee-a947-a2a06469a986 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:13:59.108931 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 208dee27-a2bc-4eee-a947-a2a06469a986. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:13:59.109425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Creating volume glance metadata for volume 208dee27-a2bc-4eee-a947-a2a06469a986 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:13:59.162158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12ad0294-3d5a-4228-8ea4-2f0d88ff9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208dee27-a2bc-4eee-a947-a2a06469a986', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:59.164351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef8dac3-fa2b-4cff-89ba-db9909754ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:13:59.173542 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Volume volume-208dee27-a2bc-4eee-a947-a2a06469a986 (208dee27-a2bc-4eee-a947-a2a06469a986): created successfully Nov 06 21:13:59.175327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ef8dac3-fa2b-4cff-89ba-db9909754ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:13:59.178177 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (88c9d927-c5d5-4929-9991-88239baa63b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:13:59.187164 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9747af72-e671-4982-a5c5-f9f47eab8d4d tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:13:59.505433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7230bf99-6fb7-40b0-8654-d9c5841359cb tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:13:59.925335 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7230bf99-6fb7-40b0-8654-d9c5841359cb tempest-TestVolumeBootPattern-1370352342 None] Create snapshot completed successfully Nov 06 21:14:02.892728 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:14:02.896033 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:02.896507 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:02.920199 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (11ec5e57-5f9c-4804-95c4-340e53a6f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:02.924008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a69ed-c030-4826-ad4b-9c794c9d74d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:02.931115 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:14:02.944270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6a69ed-c030-4826-ad4b-9c794c9d74d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:14:03Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=6fa28a34-a1e0-4586-aaf3-971ed8cf6240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3c5000a8-e03a-4e24-bc89-dd47a4e195c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:14:03Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:02.947093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f5d6c-5990-4288-9dc4-4f4562ff59f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:02.949169 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f5d6c-5990-4288-9dc4-4f4562ff59f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:02.951449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02c00bb-d68d-45fb-b81d-86d18cb5a07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:02.954182 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e02c00bb-d68d-45fb-b81d-86d18cb5a07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'volume_name': 'volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'volume_size': 1, 'snapshot_id': '3c5000a8-e03a-4e24-bc89-dd47a4e195c6'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:02.956397 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff0df3d-a0fd-4104-99ea-1a5db24622cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:02.958416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff0df3d-a0fd-4104-99ea-1a5db24622cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:02.960541 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03687546-798c-483d-9c86-8a967d8549f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:02.961291 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Volume 6fa28a34-a1e0-4586-aaf3-971ed8cf6240: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'volume_size': 1, 'snapshot_id': '3c5000a8-e03a-4e24-bc89-dd47a4e195c6'} Nov 06 21:14:02.979042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] cloning volumes/volume-208dee27-a2bc-4eee-a947-a2a06469a986@snapshot-3c5000a8-e03a-4e24-bc89-dd47a4e195c6 to volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240 {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:14:02.979945 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:03.061344 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:03.225630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:14:03.226209 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:14:03.245167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Marking volume 6fa28a34-a1e0-4586-aaf3-971ed8cf6240 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:14:03.250799 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from snapshot 3c5000a8-e03a-4e24-bc89-dd47a4e195c6 to 6fa28a34-a1e0-4586-aaf3-971ed8cf6240. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 06 21:14:03.282969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03687546-798c-483d-9c86-8a967d8549f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'volume_size': 1, 'snapshot_id': '3c5000a8-e03a-4e24-bc89-dd47a4e195c6'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:03.285455 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c343cb-4ee2-43cb-ad87-2ffcabe61aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:03.294403 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Volume volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240 (6fa28a34-a1e0-4586-aaf3-971ed8cf6240): created successfully Nov 06 21:14:03.296452 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16c343cb-4ee2-43cb-ad87-2ffcabe61aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:03.299493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (11ec5e57-5f9c-4804-95c4-340e53a6f90e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:03.314255 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-b9635236-f4d3-4fb5-bb51-1b9f44892734 tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:14:06.133278 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-1d871498-3496-4d59-a8c9-9c83535786ec tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:14:06.813249 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-1d871498-3496-4d59-a8c9-9c83535786ec tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.679s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:14:06.814344 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-1d871498-3496-4d59-a8c9-9c83535786ec tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:14:06.838298 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-1d871498-3496-4d59-a8c9-9c83535786ec tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '6fa28a34-a1e0-4586-aaf3-971ed8cf6240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'fdca6a72-8237-4844-9099-c8fbe07b0458'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:14:06.903930 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a0b74f86-1cda-4d28-ab73-ac85be77e6fe req-1d871498-3496-4d59-a8c9-9c83535786ec tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:14:10.114429 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:14:10.115473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:10.139494 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:10.164699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:14:18.912274 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-0317edc2-1e76-440b-8527-f1b03ff53a9e tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:14:18.912998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-0317edc2-1e76-440b-8527-f1b03ff53a9e tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment fdca6a72-8237-4844-9099-c8fbe07b0458. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:14:19.038074 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-6fa28a34-a1e0-4586-aaf3-971ed8cf6240-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:14:19.072307 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:19.153323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:14:19.162238 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-6fa28a34-a1e0-4586-aaf3-971ed8cf6240 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:14:19.367163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['9bebcb6e-8dad-4901-a2f0-00d78f8d8db6', '31bf1e44-3c20-4937-8819-85e61b980573', '3ae88316-c9b8-40f6-99ac-8a4a1d27bb42', '73fb21db-f1ac-4159-b8cb-bc0aab0dad47'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:14:19.409278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:19.434939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:19.462602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:14:19.467884 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:14:19.480573 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-0f9e0f7b-5b3e-483b-b40f-a1b7192a23a5 req-d375181c-cf41-46e5-ae42-317bf6bc6d87 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-6fa28a34-a1e0-4586-aaf3-971ed8cf6240-delete_volume'" released by "delete_volume" :: held 0.443s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:14:20.330131 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-beefde6b-feec-4b51-a30d-899fe64407fb tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-3c5000a8-e03a-4e24-bc89-dd47a4e195c6-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:14:20.331761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-beefde6b-feec-4b51-a30d-899fe64407fb tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:20.870943 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-beefde6b-feec-4b51-a30d-899fe64407fb tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['7835f0c8-22c9-431c-9251-31b02a2d03ec', 'ae63c429-5db8-4523-91f5-d3ae351d4bf5', 'e367e83f-b06e-4d71-8d0b-7ac1dbe95410', 'c1c74d85-9e24-47a9-a8b4-0c6907cf0a2f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:14:20.910086 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-beefde6b-feec-4b51-a30d-899fe64407fb tempest-TestVolumeBootPattern-1370352342 None] Delete snapshot completed successfully. Nov 06 21:14:20.914946 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-beefde6b-feec-4b51-a30d-899fe64407fb tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-3c5000a8-e03a-4e24-bc89-dd47a4e195c6-delete_snapshot'" released by "delete_snapshot" :: held 0.585s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:14:21.426384 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-208dee27-a2bc-4eee-a947-a2a06469a986-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:14:21.459089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:21.521451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:14:21.528189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-208dee27-a2bc-4eee-a947-a2a06469a986 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:14:21.729877 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:14:21.762617 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] deleting parent snapshot volume-208dee27-a2bc-4eee-a947-a2a06469a986.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:14:22.879992 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['586c4f30-a08e-43bd-82fd-14553e320077', 'c5a23b85-a3dc-490d-beba-25245fa01dd6', 'b6eb96cb-337e-4f19-8e79-bc8058bd1f6c', 'f0d8e5ab-007a-4a12-ae0b-b9669f4b3130'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:14:22.922920 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:22.946373 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:22.970840 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:14:22.974854 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:14:22.985956 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-cd8476bc-b66a-468a-95a5-51375b84be2f tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-208dee27-a2bc-4eee-a947-a2a06469a986-delete_volume'" released by "delete_volume" :: held 1.560s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:14:24.008109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:14:24.011711 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:24.012183 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:24.024090 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (b2bf6e6e-7fc0-435c-bea0-46319ea2cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:24.027257 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe32e3dc-a4d4-4423-bcd0-60d36df00ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:24.033427 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:14:24.045595 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe32e3dc-a4d4-4423-bcd0-60d36df00ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:14:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-365216216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=30e31686-d6ad-41a8-9b56-75a9763a23d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:14:24Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:24.048814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c73cdcd-0645-4a45-bd2b-fffdb9907311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:24.051587 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c73cdcd-0645-4a45-bd2b-fffdb9907311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:24.054201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca0bc95-fb87-4cd2-b7ea-dcc5b8a9c6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:24.130247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ca0bc95-fb87-4cd2-b7ea-dcc5b8a9c6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30e31686-d6ad-41a8-9b56-75a9763a23d5', 'volume_name': 'volume-30e31686-d6ad-41a8-9b56-75a9763a23d5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:24.132584 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a561cd9-9cf6-4253-9339-d0aff773d1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:24.134677 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a561cd9-9cf6-4253-9339-d0aff773d1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:24.136874 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d04c74d-797a-4e1a-888e-74c27ccb4100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:24.137690 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Volume 30e31686-d6ad-41a8-9b56-75a9763a23d5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30e31686-d6ad-41a8-9b56-75a9763a23d5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:14:24.138247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Cloning 30e31686-d6ad-41a8-9b56-75a9763a23d5 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:14:24.146972 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:14:24.155983 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 14, 24, 150991)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:14:24.157017 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:14:24.157405 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:14:24.161784 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:14:24.162637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:14:24.168353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 14, 24, 166172)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:14:24.168756 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:14:24.169135 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:14:24.180578 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:24.228086 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] creating snapshot='volume-30e31686-d6ad-41a8-9b56-75a9763a23d5.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:14:24.849527 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-30e31686-d6ad-41a8-9b56-75a9763a23d5.clone_snap' to 'volume-30e31686-d6ad-41a8-9b56-75a9763a23d5' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:14:25.015906 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:14:25.020735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:14:25.021162 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:14:25.042802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:14:25.043414 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Marking volume 30e31686-d6ad-41a8-9b56-75a9763a23d5 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:14:25.051615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 30e31686-d6ad-41a8-9b56-75a9763a23d5. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:14:25.052251 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Creating volume glance metadata for volume 30e31686-d6ad-41a8-9b56-75a9763a23d5 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:14:25.097896 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d04c74d-797a-4e1a-888e-74c27ccb4100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30e31686-d6ad-41a8-9b56-75a9763a23d5', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:25.100013 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e355b0e-3e7f-45e4-ba12-aa9598e18caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:25.107228 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Volume volume-30e31686-d6ad-41a8-9b56-75a9763a23d5 (30e31686-d6ad-41a8-9b56-75a9763a23d5): created successfully Nov 06 21:14:25.109110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e355b0e-3e7f-45e4-ba12-aa9598e18caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:25.112572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (b2bf6e6e-7fc0-435c-bea0-46319ea2cb90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:25.119162 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-00c65111-11eb-43e4-8d48-aaf52a5e5b0c tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:14:27.901881 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-873c77a8-0e80-4711-8743-111d61213434 req-1976dbb7-8e18-4197-b0f2-ca3a18cfec54 tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:14:28.648416 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-873c77a8-0e80-4711-8743-111d61213434 req-1976dbb7-8e18-4197-b0f2-ca3a18cfec54 tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.746s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:14:28.649595 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-873c77a8-0e80-4711-8743-111d61213434 req-1976dbb7-8e18-4197-b0f2-ca3a18cfec54 tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-30e31686-d6ad-41a8-9b56-75a9763a23d5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '30e31686-d6ad-41a8-9b56-75a9763a23d5', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:14:28.678851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-873c77a8-0e80-4711-8743-111d61213434 req-1976dbb7-8e18-4197-b0f2-ca3a18cfec54 tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-30e31686-d6ad-41a8-9b56-75a9763a23d5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '30e31686-d6ad-41a8-9b56-75a9763a23d5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'f87be3ab-b964-4b41-a3d7-16307c0faf88'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:14:28.727090 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-873c77a8-0e80-4711-8743-111d61213434 req-1976dbb7-8e18-4197-b0f2-ca3a18cfec54 tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:14:40.310731 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 req-09a900f2-8ebf-4a86-8e0a-334398fb6fe3 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:40.977558 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-db6ec8fb-f420-4e2a-a49f-ec0cd71dd9b8 req-09a900f2-8ebf-4a86-8e0a-334398fb6fe3 tempest-TestVolumeBootPattern-1370352342 None] Create snapshot completed successfully Nov 06 21:14:44.851388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:14:44.878336 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:14:44.891235 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:14:44.908743 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b5c7eb3b-720a-4238-9243-cc27bf194957 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:14:44.941693 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (05daa11b-9a9a-4992-9fd8-4f2f9e1225a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:44.945240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12ed649-b282-42fc-a2de-ce8d1928fe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:44.972456 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12ed649-b282-42fc-a2de-ce8d1928fe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:14:44Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=1c632614-ffad-4712-8c9f-1812e63030db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=30252fc7-a962-49e0-ab42-1a1dbbd09d60,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:14:45Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:44.975837 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f9d347-2304-4658-add4-8fb9462978a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:44.978733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57f9d347-2304-4658-add4-8fb9462978a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:44.982748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce318ac2-57d3-422b-ad96-a6e2e0ecc7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:44.985940 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce318ac2-57d3-422b-ad96-a6e2e0ecc7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1c632614-ffad-4712-8c9f-1812e63030db', 'volume_name': 'volume-1c632614-ffad-4712-8c9f-1812e63030db', 'volume_size': 1, 'snapshot_id': '30252fc7-a962-49e0-ab42-1a1dbbd09d60'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:44.988848 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c607da8-d97d-4ce4-bf78-06e061e382e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:44.991393 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c607da8-d97d-4ce4-bf78-06e061e382e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:44.994189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a081d424-03a5-43db-8e5c-93242d3027ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:44.995868 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Volume 1c632614-ffad-4712-8c9f-1812e63030db: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1c632614-ffad-4712-8c9f-1812e63030db', 'volume_size': 1, 'snapshot_id': '30252fc7-a962-49e0-ab42-1a1dbbd09d60'} Nov 06 21:14:45.040152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] cloning volumes/volume-30e31686-d6ad-41a8-9b56-75a9763a23d5@snapshot-30252fc7-a962-49e0-ab42-1a1dbbd09d60 to volume-1c632614-ffad-4712-8c9f-1812e63030db {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:14:45.042249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:45.192872 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:14:45.434729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:14:45.435388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:14:45.473711 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Marking volume 1c632614-ffad-4712-8c9f-1812e63030db as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:14:45.486141 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from snapshot 30252fc7-a962-49e0-ab42-1a1dbbd09d60 to 1c632614-ffad-4712-8c9f-1812e63030db. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 06 21:14:45.558955 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a081d424-03a5-43db-8e5c-93242d3027ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c632614-ffad-4712-8c9f-1812e63030db', 'volume_size': 1, 'snapshot_id': '30252fc7-a962-49e0-ab42-1a1dbbd09d60'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:45.561456 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e3fc7-4b14-4bc5-9207-2640b10296a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:14:45.573766 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Volume volume-1c632614-ffad-4712-8c9f-1812e63030db (1c632614-ffad-4712-8c9f-1812e63030db): created successfully Nov 06 21:14:45.576092 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624e3fc7-4b14-4bc5-9207-2640b10296a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:14:45.582379 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (05daa11b-9a9a-4992-9fd8-4f2f9e1225a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:14:45.605357 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-33d2d3fd-cc6e-4dd2-904e-66ee80506769 tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:14:48.386207 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-1ca7723a-f7d1-4307-a64e-f9d08d522388 tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:14:49.615224 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-1ca7723a-f7d1-4307-a64e-f9d08d522388 tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 1.237s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:14:49.617247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-1ca7723a-f7d1-4307-a64e-f9d08d522388 tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-1c632614-ffad-4712-8c9f-1812e63030db', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '1c632614-ffad-4712-8c9f-1812e63030db', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:14:49.663594 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-1ca7723a-f7d1-4307-a64e-f9d08d522388 tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-1c632614-ffad-4712-8c9f-1812e63030db', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '1c632614-ffad-4712-8c9f-1812e63030db', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '9a46539a-c1c9-4150-b7cd-6cd15f899557'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:14:49.770478 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-bcc6683b-dc82-45b7-bfc9-3602902f1175 req-1ca7723a-f7d1-4307-a64e-f9d08d522388 tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:15:01.919797 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-1033af21-841a-45c3-9288-513af08aab06 req-6b153975-147c-48e0-9b6c-813b05fad393 tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:15:01.921122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-1033af21-841a-45c3-9288-513af08aab06 req-6b153975-147c-48e0-9b6c-813b05fad393 tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment 9a46539a-c1c9-4150-b7cd-6cd15f899557. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:15:02.103269 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-1c632614-ffad-4712-8c9f-1812e63030db-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:02.144700 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:02.255970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:15:02.268312 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-1c632614-ffad-4712-8c9f-1812e63030db {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:15:02.690631 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['74742818-80fd-42d6-b87e-7a10bdbee2dc', '655a8a44-9f29-45fc-908c-1234c5f658f2', 'b6b82a8d-807b-4917-8055-c628eaba2b09', '18eab709-ff35-4736-be0a-1b9a41d866b6'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:15:02.739296 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:02.772659 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:02.809758 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:15:02.829924 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:15:02.845916 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-1033af21-841a-45c3-9288-513af08aab06 req-453d28f6-b3c1-4fb5-98fb-3e4524d7bea6 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-1c632614-ffad-4712-8c9f-1812e63030db-delete_volume'" released by "delete_volume" :: held 0.742s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:03.122666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-addd49dd-bb8d-4213-b3ef-c35e642e5c16 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-30252fc7-a962-49e0-ab42-1a1dbbd09d60-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:03.124627 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-addd49dd-bb8d-4213-b3ef-c35e642e5c16 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:10.114847 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:15:10.115602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:10.141291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:10.167030 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:15:33.318995 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-addd49dd-bb8d-4213-b3ef-c35e642e5c16 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['f823e1b2-be9d-4f84-95e7-36404e048a42', '5cc3a237-0d45-466b-9805-9464199eeed3', 'dfaf9ace-7720-43f5-8fb1-8e34ade65407', 'cfdd7cc6-c064-4521-b3bd-e63166bd3607'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:15:33.356493 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-addd49dd-bb8d-4213-b3ef-c35e642e5c16 tempest-TestVolumeBootPattern-1370352342 None] Delete snapshot completed successfully. Nov 06 21:15:33.361058 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-addd49dd-bb8d-4213-b3ef-c35e642e5c16 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-30252fc7-a962-49e0-ab42-1a1dbbd09d60-delete_snapshot'" released by "delete_snapshot" :: held 30.239s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:36.304637 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-784696f5-fc5d-4ae9-92fc-62e4c11e5243 tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:15:36.305271 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-784696f5-fc5d-4ae9-92fc-62e4c11e5243 tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment f87be3ab-b964-4b41-a3d7-16307c0faf88. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:15:36.436838 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-30e31686-d6ad-41a8-9b56-75a9763a23d5-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:36.476500 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:36.558532 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:15:36.570377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-30e31686-d6ad-41a8-9b56-75a9763a23d5 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:15:36.799876 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:15:36.832739 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] deleting parent snapshot volume-30e31686-d6ad-41a8-9b56-75a9763a23d5.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:15:37.859022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['f41c7a8a-c5a6-451e-9075-882e36685b85', '4fcc29ee-d51f-425e-b872-71f8324131c7', 'b47288d7-c0f9-4691-aa58-3e0808183bfc', '421f005e-e2f9-4eb7-a092-ffc80178919a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:15:37.897903 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:37.921564 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:37.943959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:15:37.948697 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:15:37.959799 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-bc8b8772-0110-47c7-adc4-1c1315a51c95 req-e3330f04-df22-4cf6-b2aa-88f011489845 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-30e31686-d6ad-41a8-9b56-75a9763a23d5-delete_volume'" released by "delete_volume" :: held 1.523s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:40.125304 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:15:40.128804 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:15:40.129282 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:15:40.142024 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (0c637e79-c6c3-4715-a255-aa3d06ef2d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:40.145166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3810ddd6-7bbe-4687-912c-bbd3e5d7baed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.152000 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:15:40.164621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3810ddd6-7bbe-4687-912c-bbd3e5d7baed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:15:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1537777092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ddbc94d984ebb9aa64f586ae2fbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:15:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:15:40Z,use_quota=True,user_id='1c526b6ddfc74a84b74b8f2608a0ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.167941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386046c3-eedd-4232-b54c-a4d0a37be750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.170033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (386046c3-eedd-4232-b54c-a4d0a37be750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.172340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1b4465-2b0e-4a47-b59a-79328e04b999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.174498 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d1b4465-2b0e-4a47-b59a-79328e04b999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'volume_name': 'volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.176725 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0146cd-01b7-4934-80dc-86a1b78b8875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.178758 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad0146cd-01b7-4934-80dc-86a1b78b8875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.180871 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749569ab-5d42-4dcb-90c8-829beeae166b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.181656 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Volume 3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'volume_size': 1} Nov 06 21:15:40.182045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] creating volume 'volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:15:40.183051 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:40.235835 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:15:40.236211 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:15:40.238240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749569ab-5d42-4dcb-90c8-829beeae166b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.240388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f576a4-c659-4047-80a8-41b67a64e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:40.249160 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d (3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d): created successfully Nov 06 21:15:40.250946 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46f576a4-c659-4047-80a8-41b67a64e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:40.253850 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (0c637e79-c6c3-4715-a255-aa3d06ef2d19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:40.263571 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-49bf9fda-1eee-4323-aec0-d08e7f9fdfe4 tempest-AttachVolumeTestJSON-2096905218 None] Created volume successfully. Nov 06 21:15:40.974748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:15:40.978380 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:15:40.979315 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:15:40.990466 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (a179bf62-6315-44d3-b877-c4a750e1687a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:40.993924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf48ff-b08c-4aa5-8eb6-fd6152ce7c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:41.000073 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:15:41.013929 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47cf48ff-b08c-4aa5-8eb6-fd6152ce7c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-origin-1543533190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ae02902c-20dc-4c0a-94a0-2e35f8de1240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:15:41Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:41.016469 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6055a645-025e-4819-b324-583ecdfa2238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:41.018620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6055a645-025e-4819-b324-583ecdfa2238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:41.020927 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7086884-4a91-4125-bd9d-6ee7d2cfe5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:41.103814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7086884-4a91-4125-bd9d-6ee7d2cfe5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'volume_name': 'volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:41.106132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f305000-754e-4508-94e8-5e8da97d5f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:41.108241 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f305000-754e-4508-94e8-5e8da97d5f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:41.110402 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8217b53-3a21-4fec-8e94-2562ca5f6934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:41.112101 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Volume ae02902c-20dc-4c0a-94a0-2e35f8de1240: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:15:41.112724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Cloning ae02902c-20dc-4c0a-94a0-2e35f8de1240 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:15:41.122257 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:41.132404 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 15, 41, 127000)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:15:41.133098 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:15:41.133220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:15:41.137951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:41.139096 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:15:41.145642 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 15, 41, 143037)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:15:41.146157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:15:41.146544 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:15:41.157921 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:41.211240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] creating snapshot='volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:15:41.849791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240.clone_snap' to 'volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:15:41.864945 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc req-b45b34c3-5fc2-4b17-9112-bf383b4a3869 tempest-AttachVolumeTestJSON-2096905218 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:15:42.001333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:15:42.006813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:15:42.007193 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:15:42.026448 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:15:42.027259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Marking volume ae02902c-20dc-4c0a-94a0-2e35f8de1240 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:15:42.036480 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to ae02902c-20dc-4c0a-94a0-2e35f8de1240. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:15:42.036909 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Creating volume glance metadata for volume ae02902c-20dc-4c0a-94a0-2e35f8de1240 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:15:42.086359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8217b53-3a21-4fec-8e94-2562ca5f6934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:42.089267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1178376-9cdc-441e-b552-4c206ea1e923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:42.097035 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Volume volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240 (ae02902c-20dc-4c0a-94a0-2e35f8de1240): created successfully Nov 06 21:15:42.098823 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1178376-9cdc-441e-b552-4c206ea1e923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:42.101795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (a179bf62-6315-44d3-b877-c4a750e1687a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:42.109712 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2142868c-7c61-4143-8672-ae33d67cff82 tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:15:42.552796 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc req-b45b34c3-5fc2-4b17-9112-bf383b4a3869 tempest-AttachVolumeTestJSON-2096905218 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.688s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:15:42.553519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc req-b45b34c3-5fc2-4b17-9112-bf383b4a3869 tempest-AttachVolumeTestJSON-2096905218 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:15:42.573246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc req-b45b34c3-5fc2-4b17-9112-bf383b4a3869 tempest-AttachVolumeTestJSON-2096905218 None] Connection info returned from driver {'name': 'volumes/volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b943fd6b-7ac0-49ad-8fcb-b032ce2dc55d'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:15:42.618232 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-4abb8f6c-3e2e-4c50-90df-2600d68ce3dc req-b45b34c3-5fc2-4b17-9112-bf383b4a3869 tempest-AttachVolumeTestJSON-2096905218 None] attachment_update completed successfully. Nov 06 21:15:45.010761 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:15:45.014823 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:15:45.015505 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:15:45.034903 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (faee93a8-50a0-47e1-8b27-b5117413cb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:45.038987 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d480397-dee1-452b-ae04-c5b4f0be2657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.045908 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:15:45.059554 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d480397-dee1-452b-ae04-c5b4f0be2657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2139664301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=651b92bb-26f2-4ee5-af90-ea7056902361,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487ddbc94d984ebb9aa64f586ae2fbf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:15:45Z,use_quota=True,user_id='1c526b6ddfc74a84b74b8f2608a0ee15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.062418 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c729c493-3796-4f0a-ae75-3876b915944c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.064782 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c729c493-3796-4f0a-ae75-3876b915944c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.067715 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f2b24-b77e-48d5-857e-16f4fe320ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.069732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (333f2b24-b77e-48d5-857e-16f4fe320ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651b92bb-26f2-4ee5-af90-ea7056902361', 'volume_name': 'volume-651b92bb-26f2-4ee5-af90-ea7056902361', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.072517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5db0b76-e8de-4ea6-b74b-72aa39f4fc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.074760 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5db0b76-e8de-4ea6-b74b-72aa39f4fc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.077097 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816cf7ba-6eb3-4826-8130-13043c563297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.077865 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Volume 651b92bb-26f2-4ee5-af90-ea7056902361: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651b92bb-26f2-4ee5-af90-ea7056902361', 'volume_size': 1} Nov 06 21:15:45.078281 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] creating volume 'volume-651b92bb-26f2-4ee5-af90-ea7056902361' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:15:45.079312 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:45.176254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:15:45.176933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:15:45.179089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (816cf7ba-6eb3-4826-8130-13043c563297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651b92bb-26f2-4ee5-af90-ea7056902361', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.181747 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd7527b-a258-4cd3-890a-5ce87332de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:15:45.190160 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-651b92bb-26f2-4ee5-af90-ea7056902361 (651b92bb-26f2-4ee5-af90-ea7056902361): created successfully Nov 06 21:15:45.192659 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cd7527b-a258-4cd3-890a-5ce87332de12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:15:45.195543 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Flow 'volume_create_manager' (faee93a8-50a0-47e1-8b27-b5117413cb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:15:45.205201 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-026f8bba-9dc7-406a-ad19-f71685c2b836 tempest-AttachVolumeTestJSON-2096905218 None] Created volume successfully. Nov 06 21:15:45.276417 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-6af489c1-18c1-4985-b00b-644f03bd6146 req-051542a8-d159-4e2b-834d-53620c4f9740 tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:15:45.919985 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-6af489c1-18c1-4985-b00b-644f03bd6146 req-051542a8-d159-4e2b-834d-53620c4f9740 tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:15:45.920799 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-6af489c1-18c1-4985-b00b-644f03bd6146 req-051542a8-d159-4e2b-834d-53620c4f9740 tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:15:45.942616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-6af489c1-18c1-4985-b00b-644f03bd6146 req-051542a8-d159-4e2b-834d-53620c4f9740 tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5c2c23cb-fffc-405a-b0dc-1ab6b3290632'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:15:46.001840 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-6af489c1-18c1-4985-b00b-644f03bd6146 req-051542a8-d159-4e2b-834d-53620c4f9740 tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:15:46.546971 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-267b9a32-6875-4cc1-9b8d-b08a080244b1 req-63299a0d-5f18-46ab-be86-c3c07fed5c6f tempest-AttachVolumeTestJSON-2096905218 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:15:47.219193 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-267b9a32-6875-4cc1-9b8d-b08a080244b1 req-63299a0d-5f18-46ab-be86-c3c07fed5c6f tempest-AttachVolumeTestJSON-2096905218 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.672s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:15:47.220017 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-267b9a32-6875-4cc1-9b8d-b08a080244b1 req-63299a0d-5f18-46ab-be86-c3c07fed5c6f tempest-AttachVolumeTestJSON-2096905218 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-651b92bb-26f2-4ee5-af90-ea7056902361', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '651b92bb-26f2-4ee5-af90-ea7056902361', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:15:47.245962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-267b9a32-6875-4cc1-9b8d-b08a080244b1 req-63299a0d-5f18-46ab-be86-c3c07fed5c6f tempest-AttachVolumeTestJSON-2096905218 None] Connection info returned from driver {'name': 'volumes/volume-651b92bb-26f2-4ee5-af90-ea7056902361', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '651b92bb-26f2-4ee5-af90-ea7056902361', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '70ca15dd-b506-44c6-b99f-3e429fddbc53'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:15:47.297229 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-267b9a32-6875-4cc1-9b8d-b08a080244b1 req-63299a0d-5f18-46ab-be86-c3c07fed5c6f tempest-AttachVolumeTestJSON-2096905218 None] attachment_update completed successfully. Nov 06 21:15:49.684278 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-8be7a172-35ab-4f72-858c-f9ada21d160b req-77d4d2d8-a4f7-457d-8e88-82213e82090f tempest-AttachVolumeTestJSON-2096905218 None] Terminate volume connection completed successfully. Nov 06 21:15:49.684918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8be7a172-35ab-4f72-858c-f9ada21d160b req-77d4d2d8-a4f7-457d-8e88-82213e82090f tempest-AttachVolumeTestJSON-2096905218 None] Deleting attachment b943fd6b-7ac0-49ad-8fcb-b032ce2dc55d. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:15:50.980287 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a70c3e1c-864e-4aa9-9310-253c470cac9a req-21b57dc0-6be8-48c5-93e6-36d0e233cf33 tempest-AttachVolumeTestJSON-2096905218 None] Terminate volume connection completed successfully. Nov 06 21:15:50.980901 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a70c3e1c-864e-4aa9-9310-253c470cac9a req-21b57dc0-6be8-48c5-93e6-36d0e233cf33 tempest-AttachVolumeTestJSON-2096905218 None] Deleting attachment 70ca15dd-b506-44c6-b99f-3e429fddbc53. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:15:57.470599 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-651b92bb-26f2-4ee5-af90-ea7056902361-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:57.510153 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:57.561471 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:15:57.561931 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-651b92bb-26f2-4ee5-af90-ea7056902361 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:15:57.569820 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] deleting rbd volume volume-651b92bb-26f2-4ee5-af90-ea7056902361 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:15:57.821167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Created reservations ['b6b15462-ef5a-477b-b135-5d7a9e4e1ed1', '020b0e1f-cf39-4a6f-90f0-4616827c94bc', 'ae9121c6-af2a-41e0-b503-879ce245c9ac', '50f7130c-5236-4852-976b-cce928a9e312'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:15:57.867195 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:57.891317 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:57.917473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:15:57.922152 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Deleted volume successfully. Nov 06 21:15:57.935262 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fe7bd7da-83fe-4830-9753-1cfbca93136f tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-651b92bb-26f2-4ee5-af90-ea7056902361-delete_volume'" released by "delete_volume" :: held 0.465s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:58.591918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:58.624267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:58.662735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:15:58.663327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:15:58.667896 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] deleting rbd volume volume-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:15:58.861116 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Created reservations ['35d9cf09-af4b-4d77-8184-e32227176a1a', 'cc191792-b2cb-4a5b-b1d2-488f22993b53', '4275bae4-2191-49cd-8bb6-46da2d126aa0', 'a023f229-9496-4c66-aeac-35f72bef291c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:15:58.904037 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:58.928947 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:58.953603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:15:58.958250 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Deleted volume successfully. Nov 06 21:15:58.970589 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ca7efee0-18b5-452e-a593-45808df77a02 tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-3bdefad8-a1e4-4f09-ab82-ee17a02e2d2d-delete_volume'" released by "delete_volume" :: held 0.379s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:15:59.784253 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-5922c86c-184f-4d10-9008-1de074a050e6-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:15:59.817451 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:15:59.852968 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:15:59.853406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Volume volume-5922c86c-184f-4d10-9008-1de074a050e6 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:15:59.858774 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] deleting rbd volume volume-5922c86c-184f-4d10-9008-1de074a050e6 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:16:00.070939 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Created reservations ['2fac3983-7c60-422a-b352-001383ea6c58', '4ef5e421-918d-48f5-9441-7071ba21aa69', 'b75f8852-5356-4a99-ade7-a5459196fca4', 'f77d9cbb-7671-478d-b16b-c9a44314b50b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:16:00.111270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:16:00.133113 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:16:00.156120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:16:00.160091 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Deleted volume successfully. Nov 06 21:16:00.172588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c9a544c2-d89a-4ce8-89f9-7d190a8fc05b tempest-AttachVolumeTestJSON-2096905218 None] Lock "b'cinder-5922c86c-184f-4d10-9008-1de074a050e6-delete_volume'" released by "delete_volume" :: held 0.388s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:16:18.917331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:16:18.921970 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:16:18.922314 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:16:18.937788 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (acbb85af-a52c-4bf5-859e-87da4f88102b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:16:18.941704 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7505052f-bd92-4fe3-944e-e41fd3e96bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:18.948751 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:16:18.965772 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7505052f-bd92-4fe3-944e-e41fd3e96bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1174571494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=5604ed9b-3982-42e7-b394-002095287e15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672009b3c8024ef891de3084390a04f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:16:19Z,use_quota=True,user_id='1644cf9a6ae142159bb3c6b69c47d827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:18.968102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c1de7c-70b4-463b-be14-b89b89634487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:18.970173 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0c1de7c-70b4-463b-be14-b89b89634487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:18.972490 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a4acc-9dc8-4822-8bda-0bb50275d83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:18.974647 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (514a4acc-9dc8-4822-8bda-0bb50275d83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5604ed9b-3982-42e7-b394-002095287e15', 'volume_name': 'volume-5604ed9b-3982-42e7-b394-002095287e15', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:18.976928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2bf3d-5547-47f2-8b90-b3068a5c52ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:18.978879 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb2bf3d-5547-47f2-8b90-b3068a5c52ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:18.981578 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3866704-c783-4520-9787-3b296366de8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:18.982312 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Volume 5604ed9b-3982-42e7-b394-002095287e15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5604ed9b-3982-42e7-b394-002095287e15', 'volume_size': 1} Nov 06 21:16:18.982703 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] creating volume 'volume-5604ed9b-3982-42e7-b394-002095287e15' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:16:18.983667 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:16:19.048231 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:16:19.049272 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:16:19.051909 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3866704-c783-4520-9787-3b296366de8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5604ed9b-3982-42e7-b394-002095287e15', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:19.054063 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cbeb40-9415-402a-a4af-0b350aed875f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:19.064360 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-5604ed9b-3982-42e7-b394-002095287e15 (5604ed9b-3982-42e7-b394-002095287e15): created successfully Nov 06 21:16:19.066759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61cbeb40-9415-402a-a4af-0b350aed875f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:19.070127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (acbb85af-a52c-4bf5-859e-87da4f88102b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:16:19.077766 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-69ef5bff-97fe-4a37-a7fb-6eb4b9c24bf7 tempest-AttachVolumeNegativeTest-995217399 None] Created volume successfully. Nov 06 21:16:20.400664 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a85224c2-3f2c-4210-9920-eef2785f5af4 req-c8dcec17-022d-41c7-aa42-2e24727037a8 tempest-AttachVolumeNegativeTest-995217399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:16:21.155560 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a85224c2-3f2c-4210-9920-eef2785f5af4 req-c8dcec17-022d-41c7-aa42-2e24727037a8 tempest-AttachVolumeNegativeTest-995217399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.755s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:16:21.156679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a85224c2-3f2c-4210-9920-eef2785f5af4 req-c8dcec17-022d-41c7-aa42-2e24727037a8 tempest-AttachVolumeNegativeTest-995217399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-5604ed9b-3982-42e7-b394-002095287e15', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '5604ed9b-3982-42e7-b394-002095287e15', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:16:21.183157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a85224c2-3f2c-4210-9920-eef2785f5af4 req-c8dcec17-022d-41c7-aa42-2e24727037a8 tempest-AttachVolumeNegativeTest-995217399 None] Connection info returned from driver {'name': 'volumes/volume-5604ed9b-3982-42e7-b394-002095287e15', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '5604ed9b-3982-42e7-b394-002095287e15', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '30e3dd65-b424-4a36-b582-7b44bac8a1b3'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:16:21.229621 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a85224c2-3f2c-4210-9920-eef2785f5af4 req-c8dcec17-022d-41c7-aa42-2e24727037a8 tempest-AttachVolumeNegativeTest-995217399 None] attachment_update completed successfully. Nov 06 21:16:38.919806 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-7121a5aa-e9c9-4400-be91-694ff7282398 req-c00c6698-aa74-431c-9d59-27d8d03dc158 tempest-AttachVolumeNegativeTest-995217399 None] Terminate volume connection completed successfully. Nov 06 21:16:38.920606 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-7121a5aa-e9c9-4400-be91-694ff7282398 req-c00c6698-aa74-431c-9d59-27d8d03dc158 tempest-AttachVolumeNegativeTest-995217399 None] Deleting attachment 30e3dd65-b424-4a36-b582-7b44bac8a1b3. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:16:52.061109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:16:52.065549 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:16:52.066087 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:16:52.078042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (13e01c68-ac83-4f69-bd23-183dad07f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:16:52.081208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c29ea3-a2d1-4647-b50b-3926002a5db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.089106 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:16:52.101287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c29ea3-a2d1-4647-b50b-3926002a5db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1220035772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672009b3c8024ef891de3084390a04f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:16:52Z,use_quota=True,user_id='1644cf9a6ae142159bb3c6b69c47d827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.103759 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89bcb6a-daf2-45af-85df-ebb9efdebab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.105843 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a89bcb6a-daf2-45af-85df-ebb9efdebab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.108660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0fbbea-2beb-4b0a-9576-220e06fe3357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.110829 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0fbbea-2beb-4b0a-9576-220e06fe3357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'volume_name': 'volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.113089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715fcb67-2ba0-4f0d-9f89-7553d5248249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.115129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (715fcb67-2ba0-4f0d-9f89-7553d5248249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.117287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850e5a8f-0f04-45f3-9960-f81c46a28717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.118042 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Volume e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'volume_size': 1} Nov 06 21:16:52.118446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] creating volume 'volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:16:52.119517 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:16:52.171257 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:16:52.171630 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:16:52.173634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (850e5a8f-0f04-45f3-9960-f81c46a28717) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.175706 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc33ec8-8b0f-4143-95e8-decbcec87ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:16:52.184132 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac (e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac): created successfully Nov 06 21:16:52.186534 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc33ec8-8b0f-4143-95e8-decbcec87ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:16:52.189331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (13e01c68-ac83-4f69-bd23-183dad07f378) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:16:52.197038 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fccacd20-4078-45a9-a4e7-1b7233dc9eaf tempest-AttachVolumeNegativeTest-995217399 None] Created volume successfully. Nov 06 21:16:53.461641 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-ec29e70a-f019-43ef-bf44-22d430ca370b req-4d1822ff-282f-40aa-a8eb-790b5e78c3d0 tempest-AttachVolumeNegativeTest-995217399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:16:54.149504 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-ec29e70a-f019-43ef-bf44-22d430ca370b req-4d1822ff-282f-40aa-a8eb-790b5e78c3d0 tempest-AttachVolumeNegativeTest-995217399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.687s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:16:54.150312 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-ec29e70a-f019-43ef-bf44-22d430ca370b req-4d1822ff-282f-40aa-a8eb-790b5e78c3d0 tempest-AttachVolumeNegativeTest-995217399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:16:54.174099 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-ec29e70a-f019-43ef-bf44-22d430ca370b req-4d1822ff-282f-40aa-a8eb-790b5e78c3d0 tempest-AttachVolumeNegativeTest-995217399 None] Connection info returned from driver {'name': 'volumes/volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '13812097-9d89-498b-9626-641cfbe9be3c'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:16:54.217319 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-ec29e70a-f019-43ef-bf44-22d430ca370b req-4d1822ff-282f-40aa-a8eb-790b5e78c3d0 tempest-AttachVolumeNegativeTest-995217399 None] attachment_update completed successfully. Nov 06 21:16:57.533362 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-b3395863-5379-40b1-aa34-43c0a4ad73c9 req-99702339-24bd-4a70-a843-21497b7513b2 tempest-AttachVolumeNegativeTest-995217399 None] Terminate volume connection completed successfully. Nov 06 21:16:57.534076 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-b3395863-5379-40b1-aa34-43c0a4ad73c9 req-99702339-24bd-4a70-a843-21497b7513b2 tempest-AttachVolumeNegativeTest-995217399 None] Deleting attachment 13812097-9d89-498b-9626-641cfbe9be3c. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:17:09.620037 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:17:09.624585 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:17:09.625070 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:17:09.637835 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (cc081644-b81c-418f-945b-79c2f8baacc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:17:09.641009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96b78c2-6cbc-4d2d-ac97-7466f0e197c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.647398 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:17:09.659784 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96b78c2-6cbc-4d2d-ac97-7466f0e197c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-365791776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d6213b51-c08e-456c-ba51-bab6ebeaa6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='672009b3c8024ef891de3084390a04f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:17:10Z,use_quota=True,user_id='1644cf9a6ae142159bb3c6b69c47d827',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.662353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbb5b78-5a74-4956-95ee-3d2c69225c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.664449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cbb5b78-5a74-4956-95ee-3d2c69225c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.667004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b07e8a3-54cb-4720-a1c2-28067f1fbfe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.669736 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b07e8a3-54cb-4720-a1c2-28067f1fbfe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'volume_name': 'volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.671943 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798152ea-304f-4097-b506-23f990859d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.674015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (798152ea-304f-4097-b506-23f990859d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.676130 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87145f71-21d0-4316-a90a-6d0d0c99ad35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.676924 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Volume d6213b51-c08e-456c-ba51-bab6ebeaa6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'volume_size': 1} Nov 06 21:17:09.677328 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] creating volume 'volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:17:09.678391 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:09.729469 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:17:09.729794 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:17:09.732221 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87145f71-21d0-4316-a90a-6d0d0c99ad35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.734291 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21a9125-32fe-4c53-8fe7-273b94eed09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:17:09.742835 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea (d6213b51-c08e-456c-ba51-bab6ebeaa6ea): created successfully Nov 06 21:17:09.744689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b21a9125-32fe-4c53-8fe7-273b94eed09a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:17:09.748174 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Flow 'volume_create_manager' (cc081644-b81c-418f-945b-79c2f8baacc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:17:09.755183 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8315a440-c4a4-4e34-a773-2a8bdc4ab871 tempest-AttachVolumeNegativeTest-995217399 None] Created volume successfully. Nov 06 21:17:10.113611 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:17:10.114428 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:10.139167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:10.161161 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:17:11.020681 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e64dcf06-f343-4bff-8b04-81bf9f912f23 req-84c67183-889d-44d1-b006-7ccad849f2c7 tempest-AttachVolumeNegativeTest-995217399 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:17:11.653599 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-e64dcf06-f343-4bff-8b04-81bf9f912f23 req-84c67183-889d-44d1-b006-7ccad849f2c7 tempest-AttachVolumeNegativeTest-995217399 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.633s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:17:11.654441 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-e64dcf06-f343-4bff-8b04-81bf9f912f23 req-84c67183-889d-44d1-b006-7ccad849f2c7 tempest-AttachVolumeNegativeTest-995217399 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'd6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:17:11.680158 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-e64dcf06-f343-4bff-8b04-81bf9f912f23 req-84c67183-889d-44d1-b006-7ccad849f2c7 tempest-AttachVolumeNegativeTest-995217399 None] Connection info returned from driver {'name': 'volumes/volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'd6213b51-c08e-456c-ba51-bab6ebeaa6ea', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '51647b27-878e-4b8b-92d9-4509d2c7da24'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:17:11.723556 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-e64dcf06-f343-4bff-8b04-81bf9f912f23 req-84c67183-889d-44d1-b006-7ccad849f2c7 tempest-AttachVolumeNegativeTest-995217399 None] attachment_update completed successfully. Nov 06 21:17:15.077279 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-24f6feb3-88c6-4706-b20c-00eae1920342 req-60d34d69-d61c-425c-afcb-b668f0cfd372 tempest-AttachVolumeNegativeTest-995217399 None] Terminate volume connection completed successfully. Nov 06 21:17:15.077967 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-24f6feb3-88c6-4706-b20c-00eae1920342 req-60d34d69-d61c-425c-afcb-b668f0cfd372 tempest-AttachVolumeNegativeTest-995217399 None] Deleting attachment 51647b27-878e-4b8b-92d9-4509d2c7da24. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:17:15.577302 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-d6213b51-c08e-456c-ba51-bab6ebeaa6ea-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:17:15.607549 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:15.644851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:17:15.645327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:17:15.651261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] deleting rbd volume volume-d6213b51-c08e-456c-ba51-bab6ebeaa6ea {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:17:15.838028 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Created reservations ['37bedfea-8e5f-42fe-9384-082806db4ed0', '36345d22-61b6-425a-8d6e-3ecf75b283dc', '5e815768-6eae-4bad-86eb-be517e939e47', 'c8a16b63-5baa-4cd8-9590-f42f64ecc727'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:17:15.877729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:15.899347 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:15.922667 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:17:15.926952 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Deleted volume successfully. Nov 06 21:17:15.938409 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-9cfc98fe-d93a-4d78-b42f-1acbf05e185f tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-d6213b51-c08e-456c-ba51-bab6ebeaa6ea-delete_volume'" released by "delete_volume" :: held 0.361s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:17:20.346010 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:17:20.382710 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:20.428118 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:17:20.428683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:17:20.436637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] deleting rbd volume volume-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:17:20.690011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Created reservations ['681ffd3c-5a4c-4bc6-a2d2-93241a5a0dcb', 'da45a400-98e7-4db9-9daa-c31883f9912b', 'b327e786-43a1-4d62-a40d-2aea763ac0b1', 'd90ab43b-5d84-4dd6-a2ba-5a0ea671c83c'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:17:20.731173 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:20.755547 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:20.779450 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:17:20.783630 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Deleted volume successfully. Nov 06 21:17:20.799121 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-675e744a-533c-4717-a9d6-ac1d2963eb26 tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-e3fa3cc4-6c1b-4953-b05c-70ee7ffdecac-delete_volume'" released by "delete_volume" :: held 0.453s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:17:29.006333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-5604ed9b-3982-42e7-b394-002095287e15-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:17:29.048311 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:29.093237 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:17:29.093689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Volume volume-5604ed9b-3982-42e7-b394-002095287e15 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:17:29.101719 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] deleting rbd volume volume-5604ed9b-3982-42e7-b394-002095287e15 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:17:29.372765 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Created reservations ['d376503f-2c7e-4aad-8eb1-a704f4c8c774', '9840704d-a765-4743-83e4-330484917913', '5de00c8e-279a-44f4-972b-5123b21a9386', '03c9f438-46ae-4d86-8b78-7e5f1b83d619'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:17:29.414684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:29.453479 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:17:29.487869 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:17:29.497196 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Deleted volume successfully. Nov 06 21:17:29.512225 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bf48f6ca-d59e-48c9-8f95-bf6f04e1f762 tempest-AttachVolumeNegativeTest-995217399 None] Lock "b'cinder-5604ed9b-3982-42e7-b394-002095287e15-delete_volume'" released by "delete_volume" :: held 0.505s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:18:07.048143 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 req-8be0792e-e64c-4d11-9599-1b4d76411f93 tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:18:07.049274 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-4ceec920-e3d3-42dd-bd59-86e8a7027bd9 req-8be0792e-e64c-4d11-9599-1b4d76411f93 tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment 5c2c23cb-fffc-405a-b0dc-1ab6b3290632. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:18:10.117389 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:18:10.118918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:18:10.177972 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:18:10.222979 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:18:10.965481 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-201e30ca-5253-434e-adc0-9d55cd26c505 req-8facae7e-1592-4d3c-9864-0f61d520b071 tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:18:11.702866 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-201e30ca-5253-434e-adc0-9d55cd26c505 req-8facae7e-1592-4d3c-9864-0f61d520b071 tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.736s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:18:11.704322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-201e30ca-5253-434e-adc0-9d55cd26c505 req-8facae7e-1592-4d3c-9864-0f61d520b071 tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:18:11.739870 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-201e30ca-5253-434e-adc0-9d55cd26c505 req-8facae7e-1592-4d3c-9864-0f61d520b071 tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ae02902c-20dc-4c0a-94a0-2e35f8de1240', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '4081b000-b417-4ffd-8985-60973e69b75a'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:18:11.808330 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-201e30ca-5253-434e-adc0-9d55cd26c505 req-8facae7e-1592-4d3c-9864-0f61d520b071 tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:19:10.118599 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:19:10.119606 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:19:10.205395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:19:10.242245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:04.352671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-9b1feffa-edb0-4600-93ef-0362f0652638 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:04.986105 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-9b1feffa-edb0-4600-93ef-0362f0652638 tempest-TestVolumeBootPattern-1370352342 None] Create snapshot completed successfully Nov 06 21:20:05.822068 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:05.826600 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:05.827149 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:05.849852 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (a8745f71-c227-4e1b-a18d-da7028ad8ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:05.853491 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9b2c96-1383-495d-bef0-0be3b1b12e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:05.861261 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:05.887533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9b2c96-1383-495d-bef0-0be3b1b12e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=True,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBootPattern-volume-870471848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=16e09b99-d5aa-455d-ba29-b03c9d5e739b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98ca138427bf46a0bff4b6bfbd378ec6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c394b86f-7258-4857-9fe8-e4cabd5a19cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:06Z,use_quota=True,user_id='c4f7bb1f5db14eafbe62a5cbf95040a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:05.890186 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d1066a-5a9c-4fab-b11c-d5df7568a9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:05.892339 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1d1066a-5a9c-4fab-b11c-d5df7568a9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:05.894729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165540ab-f41b-4cb8-a52d-ad285c239534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:05.897051 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (165540ab-f41b-4cb8-a52d-ad285c239534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'volume_name': 'volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'volume_size': 1, 'snapshot_id': 'c394b86f-7258-4857-9fe8-e4cabd5a19cb'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:05.899336 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6aebc-1eeb-43d2-b471-9a2f65a0f865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:05.901585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6e6aebc-1eeb-43d2-b471-9a2f65a0f865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:05.905342 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6497d0b2-7168-44d2-bed5-1194d9f4927c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:05.905342 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Volume 16e09b99-d5aa-455d-ba29-b03c9d5e739b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'volume_size': 1, 'snapshot_id': 'c394b86f-7258-4857-9fe8-e4cabd5a19cb'} Nov 06 21:20:05.930052 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] cloning volumes/volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240@snapshot-c394b86f-7258-4857-9fe8-e4cabd5a19cb to volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:20:05.930920 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:06.006500 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:06.136689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:06.137132 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:06.155700 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Marking volume 16e09b99-d5aa-455d-ba29-b03c9d5e739b as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:20:06.163674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Copying metadata from snapshot c394b86f-7258-4857-9fe8-e4cabd5a19cb to 16e09b99-d5aa-455d-ba29-b03c9d5e739b. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:423}} Nov 06 21:20:06.193551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6497d0b2-7168-44d2-bed5-1194d9f4927c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'volume_size': 1, 'snapshot_id': 'c394b86f-7258-4857-9fe8-e4cabd5a19cb'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:06.195569 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2df930-2486-43eb-8f75-1b6ffb561775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:06.203482 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Volume volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b (16e09b99-d5aa-455d-ba29-b03c9d5e739b): created successfully Nov 06 21:20:06.205459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2df930-2486-43eb-8f75-1b6ffb561775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:06.208277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Flow 'volume_create_manager' (a8745f71-c227-4e1b-a18d-da7028ad8ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:06.220546 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6a852734-ef0c-4cf8-809c-a40896bb52f5 tempest-TestVolumeBootPattern-1370352342 None] Created volume successfully. Nov 06 21:20:08.966151 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 req-670c4833-d0b7-41e5-adf9-e18764348404 tempest-TestVolumeBootPattern-1370352342 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:20:09.705825 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 req-670c4833-d0b7-41e5-adf9-e18764348404 tempest-TestVolumeBootPattern-1370352342 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.739s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:20:09.706632 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 req-670c4833-d0b7-41e5-adf9-e18764348404 tempest-TestVolumeBootPattern-1370352342 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:20:09.732592 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 req-670c4833-d0b7-41e5-adf9-e18764348404 tempest-TestVolumeBootPattern-1370352342 None] Connection info returned from driver {'name': 'volumes/volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '16e09b99-d5aa-455d-ba29-b03c9d5e739b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '96144bb5-99c5-487b-b494-03dbfb1d33b4'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:20:09.790142 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-f6e7a2c6-c69f-4bd6-be1f-403ce959d3f8 req-670c4833-d0b7-41e5-adf9-e18764348404 tempest-TestVolumeBootPattern-1370352342 None] attachment_update completed successfully. Nov 06 21:20:10.119940 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:20:10.122059 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:10.187337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:10.238080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:14.390172 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:14.394006 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:14.394515 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:14.407197 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (d4ec7c14-f286-43b9-91aa-4aa8522ae15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:14.410337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81280042-c628-48c6-bfb9-f7e6c781d0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.416994 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:14.429325 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81280042-c628-48c6-bfb9-f7e6c781d0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-589101658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=68cb7f7b-4229-48e2-89e9-82e4015809dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458dc884fdbe4d5b90112a2f5c4a9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:14Z,use_quota=True,user_id='c1d9a9950099481b8e78dc9e86bfdc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.431744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab3eb5-8310-4e15-9140-ebbf9922fa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.434520 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ab3eb5-8310-4e15-9140-ebbf9922fa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.436844 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0691e5-0242-462d-bba9-02372aa40ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.438982 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff0691e5-0242-462d-bba9-02372aa40ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68cb7f7b-4229-48e2-89e9-82e4015809dd', 'volume_name': 'volume-68cb7f7b-4229-48e2-89e9-82e4015809dd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.441205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd20256-a7d2-44d3-823f-e153ab78b0bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.443256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdd20256-a7d2-44d3-823f-e153ab78b0bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.445412 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aab946d-5131-4788-949d-f648e04032e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.446163 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume 68cb7f7b-4229-48e2-89e9-82e4015809dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68cb7f7b-4229-48e2-89e9-82e4015809dd', 'volume_size': 1} Nov 06 21:20:14.446559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] creating volume 'volume-68cb7f7b-4229-48e2-89e9-82e4015809dd' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:14.447529 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:14.498240 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:14.498530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:14.500492 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0aab946d-5131-4788-949d-f648e04032e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68cb7f7b-4229-48e2-89e9-82e4015809dd', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.502539 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54941772-dca4-4917-bbe8-a4ec8e106265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:14.511165 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-68cb7f7b-4229-48e2-89e9-82e4015809dd (68cb7f7b-4229-48e2-89e9-82e4015809dd): created successfully Nov 06 21:20:14.512940 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54941772-dca4-4917-bbe8-a4ec8e106265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:14.515701 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (d4ec7c14-f286-43b9-91aa-4aa8522ae15c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:14.522831 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d359ff2f-d19e-4d70-a71f-6991386847d6 tempest-VolumesListAdminTestJSON-1919585555 None] Created volume successfully. Nov 06 21:20:15.719207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:15.722435 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:15.722874 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:15.735019 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (74928294-8cfd-4f3a-a838-ed829cee9ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:15.738026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8e88c5-098b-4595-9273-e2a358c3a957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.743862 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:15.756516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb8e88c5-098b-4595-9273-e2a358c3a957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1695643830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c62092e3-e9ca-4a57-9f66-452c3e67197b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458dc884fdbe4d5b90112a2f5c4a9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:16Z,use_quota=True,user_id='c1d9a9950099481b8e78dc9e86bfdc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.758933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc4426d-fa1c-4e70-92d2-08fb78bedc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.760986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bc4426d-fa1c-4e70-92d2-08fb78bedc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.763278 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36da6f86-e1b2-427d-ba9e-29f9279773ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.765423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36da6f86-e1b2-427d-ba9e-29f9279773ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c62092e3-e9ca-4a57-9f66-452c3e67197b', 'volume_name': 'volume-c62092e3-e9ca-4a57-9f66-452c3e67197b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.767592 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3d2554-534a-4312-9cd7-bb5c8ad17a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.769617 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d3d2554-534a-4312-9cd7-bb5c8ad17a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.771688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63d295c-78fe-4796-80f3-47a19501f8a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.772452 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Volume c62092e3-e9ca-4a57-9f66-452c3e67197b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c62092e3-e9ca-4a57-9f66-452c3e67197b', 'volume_size': 1} Nov 06 21:20:15.772839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] creating volume 'volume-c62092e3-e9ca-4a57-9f66-452c3e67197b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:15.773795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:15.826468 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:15.827049 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:15.829039 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d63d295c-78fe-4796-80f3-47a19501f8a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c62092e3-e9ca-4a57-9f66-452c3e67197b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.831277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b786fbf7-bf54-43eb-9ee6-83e7f2f934e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:15.841076 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-c62092e3-e9ca-4a57-9f66-452c3e67197b (c62092e3-e9ca-4a57-9f66-452c3e67197b): created successfully Nov 06 21:20:15.843113 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b786fbf7-bf54-43eb-9ee6-83e7f2f934e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:15.846006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (74928294-8cfd-4f3a-a838-ed829cee9ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:15.853644 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-817be382-3883-4c14-a9dc-cd93832e742b tempest-VolumesListAdminTestJSON-1919585555 None] Created volume successfully. Nov 06 21:20:17.057806 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:17.061262 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:17.061699 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:17.073348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (3e49c18e-f827-4f54-a7ed-2df5741cd7bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:17.076361 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b165f-5382-4ba9-a4d3-0502cd97def2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.082309 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:17.095926 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4b165f-5382-4ba9-a4d3-0502cd97def2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1739367847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=64486cc1-2577-4cc6-8baf-a5ad108834c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='458dc884fdbe4d5b90112a2f5c4a9b55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:17Z,use_quota=True,user_id='c1d9a9950099481b8e78dc9e86bfdc38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.098413 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf141886-ed1e-4aac-adc5-737d76037eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.100507 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf141886-ed1e-4aac-adc5-737d76037eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.102752 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32f358-e579-4702-9212-703c330d045a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.105635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd32f358-e579-4702-9212-703c330d045a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64486cc1-2577-4cc6-8baf-a5ad108834c1', 'volume_name': 'volume-64486cc1-2577-4cc6-8baf-a5ad108834c1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.107872 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138ac7c-1e27-4115-9cf9-ba530523ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.109932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c138ac7c-1e27-4115-9cf9-ba530523ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.112002 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43662bab-cb5a-47df-b45b-a7ddf8d2d54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.112781 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume 64486cc1-2577-4cc6-8baf-a5ad108834c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64486cc1-2577-4cc6-8baf-a5ad108834c1', 'volume_size': 1} Nov 06 21:20:17.113159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] creating volume 'volume-64486cc1-2577-4cc6-8baf-a5ad108834c1' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:17.114114 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:17.163743 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:17.164115 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:17.166304 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43662bab-cb5a-47df-b45b-a7ddf8d2d54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64486cc1-2577-4cc6-8baf-a5ad108834c1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.169036 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c59996-9009-407f-a986-6af54744d7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:17.177395 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-64486cc1-2577-4cc6-8baf-a5ad108834c1 (64486cc1-2577-4cc6-8baf-a5ad108834c1): created successfully Nov 06 21:20:17.179206 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33c59996-9009-407f-a986-6af54744d7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:17.182014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Flow 'volume_create_manager' (3e49c18e-f827-4f54-a7ed-2df5741cd7bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:17.189983 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6433d6e0-cb6b-4935-8e4f-52db3d146ac6 tempest-VolumesListAdminTestJSON-1919585555 None] Created volume successfully. Nov 06 21:20:18.491696 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:18.494921 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:18.495366 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:18.508734 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Flow 'volume_create_manager' (9478aac4-f795-4162-b6ed-3f733688deb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:18.512510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bac2e5-9db8-4c00-9aac-306fd3db5e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.518373 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:18.531061 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0bac2e5-9db8-4c00-9aac-306fd3db5e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f8ae2914-ea0e-44e0-afab-edc1f41ce319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70d77b776e0c4f50869d33d99bab1488',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:18Z,use_quota=True,user_id='453a120ca9ad44d5b7749d7f5018e8f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.533554 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1be8414-effd-411c-b5b4-0c7a571c010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.535611 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1be8414-effd-411c-b5b4-0c7a571c010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.537955 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f49b35a-a699-4e27-b78b-55c28e1968e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.540735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f49b35a-a699-4e27-b78b-55c28e1968e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8ae2914-ea0e-44e0-afab-edc1f41ce319', 'volume_name': 'volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.542860 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aebc35c-4d9d-4e94-aac2-2fdd142c37c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.544935 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4aebc35c-4d9d-4e94-aac2-2fdd142c37c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.547084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a712e42-d8be-43a9-94e9-59ad8612e4a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.547841 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Volume f8ae2914-ea0e-44e0-afab-edc1f41ce319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319', 'volume_size': 1} Nov 06 21:20:18.548232 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] creating volume 'volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:18.549244 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:18.607424 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:18.607970 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:18.610077 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a712e42-d8be-43a9-94e9-59ad8612e4a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.612228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7f558b-ff66-4489-bcbc-0e25551f4016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:18.622253 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Volume volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319 (f8ae2914-ea0e-44e0-afab-edc1f41ce319): created successfully Nov 06 21:20:18.624246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7f558b-ff66-4489-bcbc-0e25551f4016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:18.627189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Flow 'volume_create_manager' (9478aac4-f795-4162-b6ed-3f733688deb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:18.635647 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a1d5ef5c-59db-45d4-8292-fa6bb7307ade tempest-VolumesListAdminTestJSON-1555804856 None] Created volume successfully. Nov 06 21:20:19.599782 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Lock "b'cinder-f8ae2914-ea0e-44e0-afab-edc1f41ce319-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:19.624791 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:19.665615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:19.666140 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Volume volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:19.672528 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] deleting rbd volume volume-f8ae2914-ea0e-44e0-afab-edc1f41ce319 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:19.686411 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-64486cc1-2577-4cc6-8baf-a5ad108834c1-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:19.717834 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:19.779692 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:19.780090 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-64486cc1-2577-4cc6-8baf-a5ad108834c1 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:19.785928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] deleting rbd volume volume-64486cc1-2577-4cc6-8baf-a5ad108834c1 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:19.962783 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Created reservations ['7806140c-3719-43d3-91b1-ed0dcc44123f', '601ce708-e90d-4ae1-9cbb-07faefdb1a24', 'd20cd00a-f935-421e-9c9e-d5f5ba20fcaa', '47af9078-7582-46de-ae8f-31ef1133463e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:20.029877 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:20.063635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:20.099540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:20.114970 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Deleted volume successfully. Nov 06 21:20:20.139245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-5ae74576-e551-462b-9668-5b4ba824c9bc tempest-VolumesListAdminTestJSON-1555804856 None] Lock "b'cinder-f8ae2914-ea0e-44e0-afab-edc1f41ce319-delete_volume'" released by "delete_volume" :: held 0.539s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:20:20.160586 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Created reservations ['8e988941-ef51-4c85-a766-a145854ec53d', '09b8add9-e72f-43e6-af09-c82601c188fd', '4c2413cb-1b89-4a06-b8a4-122cb7b2d7e9', '689fcb15-a58b-4254-8491-4e8bb36dad68'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:20.222353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:20.257034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:20.283640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:20.288142 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Deleted volume successfully. Nov 06 21:20:20.301129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-ba8fc34b-0c79-4945-a2f1-59e361bddaf7 tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-64486cc1-2577-4cc6-8baf-a5ad108834c1-delete_volume'" released by "delete_volume" :: held 0.615s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:20:20.776483 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-c62092e3-e9ca-4a57-9f66-452c3e67197b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:20.810124 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:20.849160 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:20.849592 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-c62092e3-e9ca-4a57-9f66-452c3e67197b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:20.855009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] deleting rbd volume volume-c62092e3-e9ca-4a57-9f66-452c3e67197b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:21.062125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Created reservations ['afa061b8-370d-4664-8ab4-96a0b6888290', '185fafeb-5d4a-4d89-a319-9d4816cb9f7b', '700c36ec-4a43-4784-a6c5-9061ec16f0f3', '2f201723-e331-4c89-9db1-7328a00f2e61'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:21.105344 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:21.130340 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:21.154253 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:21.158322 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Deleted volume successfully. Nov 06 21:20:21.171602 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8bd2a67b-33ae-4903-9165-9c2d39b78197 tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-c62092e3-e9ca-4a57-9f66-452c3e67197b-delete_volume'" released by "delete_volume" :: held 0.395s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:20:21.917501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-68cb7f7b-4229-48e2-89e9-82e4015809dd-delete_volume'" acquired by "delete_volume" :: waited 0.017s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:21.973499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:22.023229 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:22.023672 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Volume volume-68cb7f7b-4229-48e2-89e9-82e4015809dd is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:22.029562 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] deleting rbd volume volume-68cb7f7b-4229-48e2-89e9-82e4015809dd {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:22.270314 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Created reservations ['647ecd46-3e9a-4cb2-b612-a0776a5b3ad3', 'e164bb1a-bbdd-4865-a832-b5cc12ab38a6', '07fafd29-bb52-4d82-92b8-d63b5e938b1d', 'abd9644b-7140-43c2-84ad-c4953f90d222'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:22.322561 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:22.356080 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:22.389457 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:22.394254 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Deleted volume successfully. Nov 06 21:20:22.411099 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-cb0c44b2-970b-4142-89f9-f95f842687db tempest-VolumesListAdminTestJSON-1919585555 None] Lock "b'cinder-68cb7f7b-4229-48e2-89e9-82e4015809dd-delete_volume'" released by "delete_volume" :: held 0.493s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:20:27.477362 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:27.481196 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:27.481633 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:27.492975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Flow 'volume_create_manager' (9ea5017c-3a78-4ace-9aa8-cc33d5f1158f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:27.496541 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16fa3a8-1a06-41e2-abec-a550d789a090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.502752 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:27.514920 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a16fa3a8-1a06-41e2-abec-a550d789a090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1351527383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ddff24f6-fa9a-40cc-af72-1b4930ba7ba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09170279c56e444eaa0a04ea65219a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:27Z,use_quota=True,user_id='fec946a2e749414aade8edd82a4bc869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.517394 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867c88ed-d057-466e-a26e-bdf6b4772d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.519477 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (867c88ed-d057-466e-a26e-bdf6b4772d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.521801 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb65984-648d-406a-86cd-6e4860940708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.523932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfb65984-648d-406a-86cd-6e4860940708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddff24f6-fa9a-40cc-af72-1b4930ba7ba8', 'volume_name': 'volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.526216 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada36ae-6382-4088-b54a-635a3517a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.528273 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ada36ae-6382-4088-b54a-635a3517a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.530410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8fdaa-ae20-4926-a709-6041e127bddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.531155 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Volume ddff24f6-fa9a-40cc-af72-1b4930ba7ba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8', 'volume_size': 1} Nov 06 21:20:27.531540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] creating volume 'volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:27.532510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:27.581125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:27.581498 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:27.583425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ef8fdaa-ae20-4926-a709-6041e127bddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.585572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06c110a-cfda-4473-9f2c-e6d4642d6701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:27.593782 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Volume volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8 (ddff24f6-fa9a-40cc-af72-1b4930ba7ba8): created successfully Nov 06 21:20:27.595540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c06c110a-cfda-4473-9f2c-e6d4642d6701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:27.598386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Flow 'volume_create_manager' (9ea5017c-3a78-4ace-9aa8-cc33d5f1158f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:27.605396 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fd1cc220-fe73-49e1-b8aa-76d5bc83eba4 tempest-VolumesTransfersTest-1504092891 None] Created volume successfully. Nov 06 21:20:28.950171 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-72620386-3b6c-4a14-986f-be37012e8c8f tempest-VolumesTransfersTest-1453985114 None] Transfer volume completed successfully. Nov 06 21:20:29.282996 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Lock "b'cinder-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:29.311688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:29.352772 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:29.353200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Volume volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:29.359245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] deleting rbd volume volume-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:29.558370 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Created reservations ['4843dfde-75dc-4d5e-a563-9ece63086f45', 'e612434b-8081-461d-be3f-4f39e3497c41', '1bf87d7f-ed5f-47b4-9b7d-28f32be59acd', '6828eb82-16d8-4b6a-9130-cbea4e5fc1aa'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:29.607722 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:29.634126 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:29.660256 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:29.666612 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Deleted volume successfully. Nov 06 21:20:29.677763 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0de6a168-8d41-48a0-a061-00baf810d79b tempest-VolumesTransfersTest-67736735 None] Lock "b'cinder-ddff24f6-fa9a-40cc-af72-1b4930ba7ba8-delete_volume'" released by "delete_volume" :: held 0.395s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:20:30.675953 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:20:30.679516 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:20:30.680056 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:20:30.692670 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Flow 'volume_create_manager' (fc91dd83-d7b2-4bb7-964b-463fc25b85db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:30.696331 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc27c66e-663e-4dea-8e9f-01cfdedd17a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.703251 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:20:30.716065 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc27c66e-663e-4dea-8e9f-01cfdedd17a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:20:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-884902229',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09170279c56e444eaa0a04ea65219a50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:20:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:20:31Z,use_quota=True,user_id='fec946a2e749414aade8edd82a4bc869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.718733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bddee00-1501-4744-8843-cbb3cd9eb3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.720955 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bddee00-1501-4744-8843-cbb3cd9eb3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.723265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc49c3a-7cd5-4514-9335-ba0a3ebecd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.725460 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc49c3a-7cd5-4514-9335-ba0a3ebecd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a', 'volume_name': 'volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.727666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbdefff-8193-4146-8b0f-f416152f51a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.729908 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efbdefff-8193-4146-8b0f-f416152f51a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.732283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee85f83-0d71-4f67-99e0-1cb440a99391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.733059 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Volume f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a', 'volume_size': 1} Nov 06 21:20:30.733449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] creating volume 'volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:20:30.734406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:30.798441 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:20:30.798838 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:20:30.800932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee85f83-0d71-4f67-99e0-1cb440a99391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.803137 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5ab963-441a-448e-8982-4ce580b50aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:20:30.811610 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Volume volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a (f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a): created successfully Nov 06 21:20:30.813713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5ab963-441a-448e-8982-4ce580b50aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:20:30.816662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Flow 'volume_create_manager' (fc91dd83-d7b2-4bb7-964b-463fc25b85db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:20:30.825608 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1f0513b5-072b-49a1-a27e-a90bb960ba61 tempest-VolumesTransfersTest-1504092891 None] Created volume successfully. Nov 06 21:20:31.996774 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Lock "b'cinder-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:20:32.021614 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:32.062885 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:20:32.063359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Volume volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:20:32.069910 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] deleting rbd volume volume-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:20:32.348005 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Created reservations ['de021fa2-029a-45d2-9a53-aad6d38d1be9', '49c8dcd4-af25-4fd5-9eb2-ac744f6178cb', '929efa0a-c3b1-4c20-9b64-2ce0587131fb', '2027b24f-fe20-49bc-b362-26d2dba2acba'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:20:32.388688 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:32.414769 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:20:32.438847 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:20:32.443075 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Deleted volume successfully. Nov 06 21:20:32.456613 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bd2e8b8c-acd8-46b5-ac3d-aadf644efbda tempest-VolumesTransfersTest-67736735 None] Lock "b'cinder-f0a4184f-ff36-4ef5-ac42-eb7ff402fd3a-delete_volume'" released by "delete_volume" :: held 0.460s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:21:07.294432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:21:07.297832 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:21:07.298277 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:21:07.310376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Flow 'volume_create_manager' (da27e4c6-a4f6-424a-a562-4a53ce5b5095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:21:07.313962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd36cd-6d12-45ea-b521-7a119b564ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:07.320435 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:21:07.334277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bd36cd-6d12-45ea-b521-7a119b564ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestVolumeBackupRestore-volume-1064209035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=864396ca-37f1-4fc1-a294-fbcb0fe5a63f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673884ca4974d97b139bf3200b87b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:21:07Z,use_quota=True,user_id='2b265dc9a43f4bbabed4a948e80f449d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:07.336788 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b199e20e-6390-4726-b82e-b477a20a8151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:07.338867 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b199e20e-6390-4726-b82e-b477a20a8151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:07.341270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5689503-27d3-4681-824e-b2fa35d5a3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:07.424360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5689503-27d3-4681-824e-b2fa35d5a3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'volume_name': 'volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:07.426622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3548c-2a50-402b-9ea5-358b32f6247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:07.428859 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb3548c-2a50-402b-9ea5-358b32f6247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:07.430949 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a53be-2527-4045-a7cc-a190fd28fedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:07.431736 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Volume 864396ca-37f1-4fc1-a294-fbcb0fe5a63f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:21:07.432320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Cloning 864396ca-37f1-4fc1-a294-fbcb0fe5a63f from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:21:07.443858 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:21:07.466998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 21, 7, 451562)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:21:07.467374 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:21:07.467837 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:21:07.475924 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.031s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:21:07.477619 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:21:07.485780 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 21, 7, 483069)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:21:07.486218 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:21:07.486622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:21:07.498633 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:21:07.556367 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] creating snapshot='volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:21:07.969322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f.clone_snap' to 'volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:21:08.100667 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:21:08.105713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:21:08.106088 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:21:08.121356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:21:08.121958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Marking volume 864396ca-37f1-4fc1-a294-fbcb0fe5a63f as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:21:08.129272 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 864396ca-37f1-4fc1-a294-fbcb0fe5a63f. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:21:08.129690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Creating volume glance metadata for volume 864396ca-37f1-4fc1-a294-fbcb0fe5a63f backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:21:08.175992 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50a53be-2527-4045-a7cc-a190fd28fedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:08.178109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdecd1f0-ce7b-4fde-b201-1dfc473a322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:08.185292 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Volume volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f (864396ca-37f1-4fc1-a294-fbcb0fe5a63f): created successfully Nov 06 21:21:08.187011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdecd1f0-ce7b-4fde-b201-1dfc473a322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:08.189816 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Flow 'volume_create_manager' (da27e4c6-a4f6-424a-a562-4a53ce5b5095) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:21:08.196563 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bf0ce3ad-6f49-47d7-8e8e-191a9497a9f0 tempest-TestVolumeBackupRestore-1683798703 None] Created volume successfully. Nov 06 21:21:08.770932 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:21:09.419836 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.649s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:21:09.420672 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '864396ca-37f1-4fc1-a294-fbcb0fe5a63f', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:21:09.436198 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] Initialize volume connection completed successfully. Nov 06 21:21:10.116671 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:21:10.117763 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:21:10.154525 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:21:10.180583 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:21:16.162687 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] Terminate volume connection completed successfully. Nov 06 21:21:16.181603 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-964c3fe3-c09c-41e7-af21-f78faf17f9b9 tempest-TestVolumeBackupRestore-1683798703 None] Remove volume export completed successfully. Nov 06 21:21:17.166533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:21:17.171131 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:21:17.171618 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:21:17.186200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Flow 'volume_create_manager' (d16a556d-a61b-4f6a-a5fd-84fe8aee19fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:21:17.189621 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a933e99-2b4a-4686-8148-5de7a465ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.196425 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:21:17.209364 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a933e99-2b4a-4686-8148-5de7a465ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:21:17Z,deleted=False,deleted_at=None,display_description='auto-created_from_restore_from_backup',display_name='restore_backup_8304e281-f852-4364-8852-02793cebb7c5',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ecc8927f-ce43-4e60-90d6-a786d9aee3e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5673884ca4974d97b139bf3200b87b43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:21:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:21:17Z,use_quota=True,user_id='2b265dc9a43f4bbabed4a948e80f449d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.211906 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715261f4-941d-4df8-8cda-33c5a72466f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.214047 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (715261f4-941d-4df8-8cda-33c5a72466f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.216362 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bb71f-5a38-4228-a684-152b8cd79c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.218589 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b93bb71f-5a38-4228-a684-152b8cd79c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'volume_name': 'volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.220881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081a08bd-6bb7-4406-a5d0-0c2ad3e0fdae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.223009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (081a08bd-6bb7-4406-a5d0-0c2ad3e0fdae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.225162 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4aecb9-a7e5-4321-9153-595bf085666e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.225961 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Volume ecc8927f-ce43-4e60-90d6-a786d9aee3e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'volume_size': 1} Nov 06 21:21:17.226356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] creating volume 'volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:21:17.227429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:21:17.290327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:21:17.290675 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:21:17.293389 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4aecb9-a7e5-4321-9153-595bf085666e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.295616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d436e2d-5eee-43b6-8058-b9c93618a98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:21:17.304733 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Volume volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5 (ecc8927f-ce43-4e60-90d6-a786d9aee3e5): created successfully Nov 06 21:21:17.306724 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d436e2d-5eee-43b6-8058-b9c93618a98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:21:17.310423 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Flow 'volume_create_manager' (d16a556d-a61b-4f6a-a5fd-84fe8aee19fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:21:17.318280 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Created volume successfully. Nov 06 21:21:18.244015 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:21:18.951799 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.707s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:21:18.952683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:21:18.969062 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Initialize volume connection completed successfully. Nov 06 21:21:22.715659 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Terminate volume connection completed successfully. Nov 06 21:21:22.734141 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c404ec06-71ae-4f71-84f1-77679411947a tempest-TestVolumeBackupRestore-1683798703 None] Remove volume export completed successfully. Nov 06 21:21:26.517764 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-61d2e347-067b-4229-82dd-c7934073f6c7 req-a2e81085-dd1b-4865-9910-c78fbfa98ff3 tempest-TestVolumeBackupRestore-1683798703 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:21:27.188704 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-61d2e347-067b-4229-82dd-c7934073f6c7 req-a2e81085-dd1b-4865-9910-c78fbfa98ff3 tempest-TestVolumeBackupRestore-1683798703 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.671s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:21:27.189538 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-61d2e347-067b-4229-82dd-c7934073f6c7 req-a2e81085-dd1b-4865-9910-c78fbfa98ff3 tempest-TestVolumeBackupRestore-1683798703 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:21:27.211680 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-61d2e347-067b-4229-82dd-c7934073f6c7 req-a2e81085-dd1b-4865-9910-c78fbfa98ff3 tempest-TestVolumeBackupRestore-1683798703 None] Connection info returned from driver {'name': 'volumes/volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ecc8927f-ce43-4e60-90d6-a786d9aee3e5', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1c947ad2-59f5-4f92-9103-b1e7b583eec4'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:21:27.259509 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-61d2e347-067b-4229-82dd-c7934073f6c7 req-a2e81085-dd1b-4865-9910-c78fbfa98ff3 tempest-TestVolumeBackupRestore-1683798703 None] attachment_update completed successfully. Nov 06 21:22:10.118915 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:22:10.120047 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:10.146448 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:10.170721 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:14.700582 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-356280a9-8a20-4083-8c8c-bdc7be47067d req-54daf143-8466-47f7-8024-bea50617b4c3 tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:22:14.701604 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-356280a9-8a20-4083-8c8c-bdc7be47067d req-54daf143-8466-47f7-8024-bea50617b4c3 tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment 96144bb5-99c5-487b-b494-03dbfb1d33b4. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:16.337209 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-16e09b99-d5aa-455d-ba29-b03c9d5e739b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:16.368070 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:16.443448 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:22:16.450164 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-16e09b99-d5aa-455d-ba29-b03c9d5e739b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:16.701321 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['a21e39bc-76c0-40eb-af7a-dffb9045c65e', '3d869fd6-67f3-4501-8fae-cfbf42a2a630', '03aecd96-593b-4cf8-91d5-f40ed7ada8d8', '86b62d49-f7d4-41f3-8c2b-dccc064320fd'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:16.741441 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:16.762940 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:16.786521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:16.790872 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:22:16.802898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-260877ac-58cb-4133-97af-65a4d79b2aa0 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-16e09b99-d5aa-455d-ba29-b03c9d5e739b-delete_volume'" released by "delete_volume" :: held 0.466s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:17.479425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c6dac58c-8577-4186-ab65-fbe7862c22de tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-c394b86f-7258-4857-9fe8-e4cabd5a19cb-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:17.481276 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c6dac58c-8577-4186-ab65-fbe7862c22de tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:21.670630 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-67adcecf-fba3-4f26-8539-b1befdf065ed tempest-TaggedBootDevicesTest-1306124712 None] Terminate volume connection completed successfully. Nov 06 21:22:21.671353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-67adcecf-fba3-4f26-8539-b1befdf065ed tempest-TaggedBootDevicesTest-1306124712 None] Deleting attachment 777569a5-a009-4a34-9802-0c0d13dced6b. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:21.797582 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-21a11598-5520-4aec-989c-7da12359b89b tempest-TaggedBootDevicesTest-1306124712 None] Terminate volume connection completed successfully. Nov 06 21:22:21.798336 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-21a11598-5520-4aec-989c-7da12359b89b tempest-TaggedBootDevicesTest-1306124712 None] Deleting attachment df70bc7f-a504-4ab9-817b-b194ee5299d0. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:21.937869 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-927f98c4-375b-427d-a6de-5569a6c33775 tempest-TaggedBootDevicesTest-1306124712 None] Terminate volume connection completed successfully. Nov 06 21:22:21.938304 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-fbd70a98-cd89-490c-898d-e0a998f90a6c req-927f98c4-375b-427d-a6de-5569a6c33775 tempest-TaggedBootDevicesTest-1306124712 None] Deleting attachment ac4f01c5-fceb-4724-bc33-5e852a1b9836. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:24.889738 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-c83b47ca-7ab9-4617-8c75-32a1585280ee req-52ad4c2b-f1ab-49c2-ab5a-391d2763dfda tempest-TestVolumeBackupRestore-1683798703 None] Terminate volume connection completed successfully. Nov 06 21:22:24.890396 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-c83b47ca-7ab9-4617-8c75-32a1585280ee req-52ad4c2b-f1ab-49c2-ab5a-391d2763dfda tempest-TestVolumeBackupRestore-1683798703 None] Deleting attachment 1c947ad2-59f5-4f92-9103-b1e7b583eec4. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:26.498407 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-ecc8927f-ce43-4e60-90d6-a786d9aee3e5-delete_volume'" acquired by "delete_volume" :: waited 0.022s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:26.540514 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:26.797493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Volume volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:22:26.828618 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] deleting rbd volume volume-ecc8927f-ce43-4e60-90d6-a786d9aee3e5 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:26.859033 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-864396ca-37f1-4fc1-a294-fbcb0fe5a63f-delete_volume'" acquired by "delete_volume" :: waited 0.025s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:26.908824 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:27.825242 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] deleting rbd volume volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:27.849186 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-4422ae34-1eb5-41ba-9b68-f992e04d069f-delete_volume'" acquired by "delete_volume" :: waited 0.015s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:27.891079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Created reservations ['a80d3219-e382-42f3-8ecd-7eb2ed54b5ec', 'b2afadcc-0262-4145-b085-9cde773ec654', 'c4f49dae-31d3-46ec-8266-15d119521544', '5e7b6c68-8be2-4c99-83a4-53f2341cfb4b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:27.901449 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:27.944105 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:22:27.944637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-4422ae34-1eb5-41ba-9b68-f992e04d069f is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:22:27.952641 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] deleting rbd volume volume-4422ae34-1eb5-41ba-9b68-f992e04d069f {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:28.010875 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:28.060180 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:28.084786 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:28.087617 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:22:28.123280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] deleting parent snapshot volume-864396ca-37f1-4fc1-a294-fbcb0fe5a63f.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:22:29.011046 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Deleted volume successfully. Nov 06 21:22:29.042349 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8d3320fa-f19b-4b94-8bb6-d65b342de61f tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-ecc8927f-ce43-4e60-90d6-a786d9aee3e5-delete_volume'" released by "delete_volume" :: held 2.542s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:29.071485 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] Created reservations ['3df1660f-a398-4bde-a964-4666076f3880', 'c442002d-b2be-4dfa-b12d-bbfcf997f02c', 'fe04c75b-4b8f-4e93-a25f-6fab79cd811d', '9cbd2afe-bdbd-4b5b-bb9b-a31fd98e7378'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:29.088894 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Created reservations ['c06cc57a-cc9c-4f58-b7bb-90ea832d85f2', 'd3bdbf0c-b911-42e7-8024-7ae47d1cacd0', '38533946-1a99-4ff9-880c-8a5c9f0abd6d', '5705f518-fc0e-4e80-87d7-0dec25dd1dc1'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:29.136979 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:29.159023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:29.181391 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:29.186157 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] Deleted volume successfully. Nov 06 21:22:29.203112 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-7c873bb3-f0b3-4cc8-949a-8ee4a1e4a7e6 tempest-TestVolumeBackupRestore-1683798703 None] Lock "b'cinder-864396ca-37f1-4fc1-a294-fbcb0fe5a63f-delete_volume'" released by "delete_volume" :: held 2.344s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:29.205191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:29.227730 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:29.249015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:29.252845 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Deleted volume successfully. Nov 06 21:22:29.264851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-fd05fc9b-4aaa-4891-a4b2-eb9f509532ca tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-4422ae34-1eb5-41ba-9b68-f992e04d069f-delete_volume'" released by "delete_volume" :: held 1.416s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:29.950513 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-4e056961-b9e2-465b-b784-f4012c5e4f43-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:29.983579 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:30.025001 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:22:30.025678 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Volume volume-4e056961-b9e2-465b-b784-f4012c5e4f43 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:22:30.031002 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] deleting rbd volume volume-4e056961-b9e2-465b-b784-f4012c5e4f43 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:30.242191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Created reservations ['97b99f55-8665-49fa-b908-668b3a2f0e94', 'fcd73dca-9605-418c-bc28-f7fa1be5b353', 'b36b672a-8e2a-457c-a025-49e7b5c45c43', '49361ae6-c944-49e4-a238-21b31d69d391'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:30.291030 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:30.315411 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:30.343608 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:30.347556 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Deleted volume successfully. Nov 06 21:22:30.361404 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-44a0d32e-4cdd-47c6-bb12-f6c1b869c80b tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-4e056961-b9e2-465b-b784-f4012c5e4f43-delete_volume'" released by "delete_volume" :: held 0.411s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:31.084493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-26bcd7cd-d641-407f-9d6e-463c54fc3025-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:31.130784 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:31.199071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:22:31.206978 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] deleting rbd volume volume-26bcd7cd-d641-407f-9d6e-463c54fc3025 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:31.452555 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:22:31.485323 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] deleting parent snapshot volume-26bcd7cd-d641-407f-9d6e-463c54fc3025.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:22:31.898551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] Created reservations ['6a6012b0-872f-4418-94d9-4b214ae523ef', '798fe18b-fa8e-4696-962a-a9f2198db01a', '965d2c12-d2db-41e6-8325-f98d8ede397e', '27da9272-1c6a-492e-b22d-4b39eee19435'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:31.951587 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:31.981790 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:32.017189 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:32.025243 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] Deleted volume successfully. Nov 06 21:22:32.043117 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-a5b40bcb-0212-4dcc-a983-fbc712cf688c tempest-TaggedBootDevicesTest-1306124712 None] Lock "b'cinder-26bcd7cd-d641-407f-9d6e-463c54fc3025-delete_volume'" released by "delete_volume" :: held 0.959s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:47.636478 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-c6dac58c-8577-4186-ab65-fbe7862c22de tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['979e24a4-7b57-49b5-9f7b-69cb270e8803', 'c1188e1a-2751-4dfe-a0ce-f2bede382226', '6d5881d9-14ef-40c8-9f7f-6802c57fb7b4', '7552a3a6-cd6c-4dc9-86f2-31451695f697'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:47.674999 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c6dac58c-8577-4186-ab65-fbe7862c22de tempest-TestVolumeBootPattern-1370352342 None] Delete snapshot completed successfully. Nov 06 21:22:47.679830 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c6dac58c-8577-4186-ab65-fbe7862c22de tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-c394b86f-7258-4857-9fe8-e4cabd5a19cb-delete_snapshot'" released by "delete_snapshot" :: held 30.201s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:22:51.856469 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 req-56571b64-bf0f-43f1-b138-db0f8f2db70d tempest-TestVolumeBootPattern-1370352342 None] Terminate volume connection completed successfully. Nov 06 21:22:51.857068 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-152309c7-bdba-445f-a2a0-a5eb6c97ab82 req-56571b64-bf0f-43f1-b138-db0f8f2db70d tempest-TestVolumeBootPattern-1370352342 None] Deleting attachment 4081b000-b417-4ffd-8985-60973e69b75a. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:22:54.119227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-ae02902c-20dc-4c0a-94a0-2e35f8de1240-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:22:54.158355 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:54.221588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:22:54.228683 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] deleting rbd volume volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:22:54.528380 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:22:54.562351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] deleting parent snapshot volume-ae02902c-20dc-4c0a-94a0-2e35f8de1240.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:22:55.009025 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] Created reservations ['1b1fe46d-7132-4e16-b1d5-330efe67d4ad', '6d159912-3dc7-4e72-8367-53e6edb938cd', 'e3ba35da-4071-417e-a69e-2738a515bbb2', 'a40d5f1a-dcb0-44be-a9e8-31452472dcec'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:22:55.057409 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:55.089779 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:22:55.116568 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:22:55.121685 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] Deleted volume successfully. Nov 06 21:22:55.135579 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-dd95e686-86c2-4adb-ad35-4a33f6ad09d7 tempest-TestVolumeBootPattern-1370352342 None] Lock "b'cinder-ae02902c-20dc-4c0a-94a0-2e35f8de1240-delete_volume'" released by "delete_volume" :: held 1.016s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:23:10.115656 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:23:10.116836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:23:10.138167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:23:10.158892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:24:10.113821 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:24:10.114499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:24:10.135529 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:24:10.157487 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:10.113677 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:25:10.115107 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:10.161113 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:10.198509 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:23.156526 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5188d2d8-6ae2-4731-bc14-76d038eea32b tempest-GroupsV314Test-582815902 None] Group tempest-GroupsV314Test-Group-677837953: creating Nov 06 21:25:23.171756 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5188d2d8-6ae2-4731-bc14-76d038eea32b tempest-GroupsV314Test-582815902 None] Group tempest-GroupsV314Test-Group-677837953: created successfully Nov 06 21:25:23.179628 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5188d2d8-6ae2-4731-bc14-76d038eea32b tempest-GroupsV314Test-582815902 None] Create group completed successfully. Nov 06 21:25:24.509989 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:24.513746 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:24.514217 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:24.526964 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Flow 'volume_create_manager' (b35b6e23-5637-4c3d-bfd6-7472ca8fd357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:24.530054 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fc124d-cb4c-4c30-a43d-84ee72ae60ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.536594 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:24.548766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62fc124d-cb4c-4c30-a43d-84ee72ae60ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-GroupsV314Test-Volume-1937304516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15521b9-8d36-4b65-a912-614392a2e21f,host='ncdv-master-1@ceph#ceph',id=34daf81a-0e44-4568-bf21-8991bccaee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e6c0f8e1fe48219e7648c8ba293b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:24Z,use_quota=True,user_id='d780ecf4b8954e798414819e21b9d6ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9ac518e-693f-4e14-ae81-271ace8f60c6),volume_type_id=d9ac518e-693f-4e14-ae81-271ace8f60c6)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.551192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6ddfff-ce31-49f3-a0f7-a02e60693c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.553261 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6ddfff-ce31-49f3-a0f7-a02e60693c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.555533 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f8f451-f789-49b5-a3c1-eae7db11f375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.557684 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8f8f451-f789-49b5-a3c1-eae7db11f375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34daf81a-0e44-4568-bf21-8991bccaee82', 'volume_name': 'volume-34daf81a-0e44-4568-bf21-8991bccaee82', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.559861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec4218-88f0-4daf-be20-dab401f68645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.561923 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fec4218-88f0-4daf-be20-dab401f68645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.564617 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caf3c3f-dd46-437b-a002-24ee401c73ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.577804 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Volume 34daf81a-0e44-4568-bf21-8991bccaee82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34daf81a-0e44-4568-bf21-8991bccaee82', 'volume_size': 1} Nov 06 21:25:24.578201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] creating volume 'volume-34daf81a-0e44-4568-bf21-8991bccaee82' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:24.579180 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:24.628254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:24.628664 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:24.630700 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8caf3c3f-dd46-437b-a002-24ee401c73ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34daf81a-0e44-4568-bf21-8991bccaee82', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.632829 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d0e79b-411b-4932-a09c-07d931058f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:24.641204 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Volume volume-34daf81a-0e44-4568-bf21-8991bccaee82 (34daf81a-0e44-4568-bf21-8991bccaee82): created successfully Nov 06 21:25:24.643569 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5d0e79b-411b-4932-a09c-07d931058f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:24.646383 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Flow 'volume_create_manager' (b35b6e23-5637-4c3d-bfd6-7472ca8fd357) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:24.653214 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bdcd67b0-a03f-452d-b293-3f69174f788f tempest-GroupsV314Test-582815902 None] Created volume successfully. Nov 06 21:25:25.916009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:25.956071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] creating snapshot='volume-49c8c9e7-f051-49e4-9964-39e6d0b58d46.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:25:27.009519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] cloning 'volume-34daf81a-0e44-4568-bf21-8991bccaee82@volume-49c8c9e7-f051-49e4-9964-39e6d0b58d46.clone_snap' to 'volume-49c8c9e7-f051-49e4-9964-39e6d0b58d46' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:25:27.109176 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] Volume volume-34daf81a-0e44-4568-bf21-8991bccaee82 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:27.120658 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] extra_specs: {} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:27.121105 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] extra_specs: {} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:27.136373 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:25:27.179001 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-3fc0d1f1-9077-4cf8-82ce-74043531f482 tempest-GroupsV314Test-582815902 None] Create group from source-group-f15521b9-8d36-4b65-a912-614392a2e21f completed successfully. Nov 06 21:25:28.432762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:28.487205 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:28.493127 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] deleting rbd volume volume-49c8c9e7-f051-49e4-9964-39e6d0b58d46 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:28.656072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:25:28.675581 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Volume volume-34daf81a-0e44-4568-bf21-8991bccaee82 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:28.676123 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] deleting parent snapshot volume-49c8c9e7-f051-49e4-9964-39e6d0b58d46.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:25:29.225186 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Created reservations ['93b3cc3b-b485-43b1-bdab-e965d404578e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:29.240505 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1139541097 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1139541097, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:29.241281 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1139541097 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1139541097, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:29.253009 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Created reservations ['3cee1124-5e2f-4cd9-89bc-0090010c817f', '057db595-b17e-4e3b-8066-12e2246de1bc', '6d4fc979-ea9f-4af0-b3ba-04a09b9d6ce7', 'd4df2334-ce59-4c4d-9a40-4023d743bc88'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:29.317846 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:29.342023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:29.364742 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:29.368747 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-47dba84f-c632-48a6-bc50-40bce67520b8 tempest-GroupsV314Test-582815902 None] Delete group completed successfully. Nov 06 21:25:29.697145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:29.745008 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:29.745373 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] Volume volume-34daf81a-0e44-4568-bf21-8991bccaee82 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:29.752004 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] deleting rbd volume volume-34daf81a-0e44-4568-bf21-8991bccaee82 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:29.947740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] Created reservations ['4c5f6cc3-ca83-4efc-b3b8-1d65416189c0'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:29.978252 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] Created reservations ['fd5612a2-403f-4d4a-8d8a-ba87377381af', '4b507cc0-5882-4d0b-844f-6ada2a1d2a54', 'bbc14703-fb80-4410-8a18-57941accab22', '85c54bcd-1e11-43e1-bb9b-56d776fd4af5'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:30.044432 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:30.066115 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:30.087548 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:30.091280 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bcceee6d-5e72-4262-89bb-5f511d65cb29 tempest-GroupsV314Test-582815902 None] Delete group completed successfully. Nov 06 21:25:33.741327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:33.744498 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:33.744940 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:33.756669 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Flow 'volume_create_manager' (667a0bc6-fd9f-40b1-bd1f-c1a6d881eaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:33.759669 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad177f89-3097-4e5a-8d5f-fdca6a024c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.765609 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:33.777946 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad177f89-3097-4e5a-8d5f-fdca6a024c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1114780634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=7b8580c6-b0b7-4852-a6bd-7ebf948d5225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ce1f5fefc6d34800a8068771f935e1b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:34Z,use_quota=True,user_id='5f54f17e22ee4bb1bd5ceb72a761a284',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.780395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326be044-a856-4185-b20a-93393625a32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.783109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (326be044-a856-4185-b20a-93393625a32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.785425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df9ef56-f5ab-4889-9459-53f0f057b52e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.787560 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5df9ef56-f5ab-4889-9459-53f0f057b52e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b8580c6-b0b7-4852-a6bd-7ebf948d5225', 'volume_name': 'volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.790072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48504ff6-f8d8-416f-85d1-8def8f42a57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.792122 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48504ff6-f8d8-416f-85d1-8def8f42a57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.794263 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9483963-fbe6-4151-8c00-aafc21790e7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.795012 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Volume 7b8580c6-b0b7-4852-a6bd-7ebf948d5225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225', 'volume_size': 1} Nov 06 21:25:33.795403 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] creating volume 'volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:33.796382 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:33.844912 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:33.845805 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:33.847812 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9483963-fbe6-4151-8c00-aafc21790e7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.849948 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc62afd-9d2f-40a6-a412-71b9ec2853fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:33.858487 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Volume volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225 (7b8580c6-b0b7-4852-a6bd-7ebf948d5225): created successfully Nov 06 21:25:33.860228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc62afd-9d2f-40a6-a412-71b9ec2853fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:33.863042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Flow 'volume_create_manager' (667a0bc6-fd9f-40b1-bd1f-c1a6d881eaa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:33.870283 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1dd158fe-39d3-43de-aa2e-090d07336253 tempest-VolumesServicesTestJSON-1124092803 None] Created volume successfully. Nov 06 21:25:34.892585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Lock "b'cinder-7b8580c6-b0b7-4852-a6bd-7ebf948d5225-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:25:34.932980 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:34.968389 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:34.968817 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Volume volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:34.975024 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] deleting rbd volume volume-7b8580c6-b0b7-4852-a6bd-7ebf948d5225 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:35.161383 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Created reservations ['3d5a4ac2-cca8-4478-b3c6-c6b62c8a025d', 'b4542347-88b9-42bb-bb0d-64b5b0460a61', '0ff4c301-9f76-4e03-9a99-22203f55dda7', '8c0ee13d-04f3-47bb-801e-a797de97afca'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:35.200167 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:35.222481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:35.245160 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:35.249303 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Deleted volume successfully. Nov 06 21:25:35.260662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0e8d2f89-936c-4940-a294-6a4256ed5359 tempest-VolumesServicesTestJSON-1124092803 None] Lock "b'cinder-7b8580c6-b0b7-4852-a6bd-7ebf948d5225-delete_volume'" released by "delete_volume" :: held 0.368s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:25:39.127796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:39.132066 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:39.132547 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:39.146616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Flow 'volume_create_manager' (5b7c731f-3d05-468e-81c5-73090518861f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:39.150043 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53991ce-6494-4143-b1a3-9006cd21bdd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.157021 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:39.169385 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f53991ce-6494-4143-b1a3-9006cd21bdd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-489249005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=c1ef7a31-6372-4877-be54-90de33f4964b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5269c933774d9c9b609ac607f2f4e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:39Z,use_quota=True,user_id='d21f43875ecd40c2a2396be4970163b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.171840 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941569b9-4175-4551-a9f3-41a00bb05e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.174485 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (941569b9-4175-4551-a9f3-41a00bb05e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.176810 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fe9a78-098c-4132-a6c0-a80087ed0a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.178936 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6fe9a78-098c-4132-a6c0-a80087ed0a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1ef7a31-6372-4877-be54-90de33f4964b', 'volume_name': 'volume-c1ef7a31-6372-4877-be54-90de33f4964b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.181153 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d57ce32-df6f-4d40-99e0-073998704191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.183159 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d57ce32-df6f-4d40-99e0-073998704191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.185275 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5e0573-d6cd-43d8-a45f-9276623d3ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.186019 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Volume c1ef7a31-6372-4877-be54-90de33f4964b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1ef7a31-6372-4877-be54-90de33f4964b', 'volume_size': 1} Nov 06 21:25:39.186406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] creating volume 'volume-c1ef7a31-6372-4877-be54-90de33f4964b' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:39.187392 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:39.234717 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:39.235093 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:39.237622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5e0573-d6cd-43d8-a45f-9276623d3ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1ef7a31-6372-4877-be54-90de33f4964b', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.239702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3619c4c-ac8c-4395-9424-19853f439f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:39.247986 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Volume volume-c1ef7a31-6372-4877-be54-90de33f4964b (c1ef7a31-6372-4877-be54-90de33f4964b): created successfully Nov 06 21:25:39.249740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3619c4c-ac8c-4395-9424-19853f439f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:39.253273 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Flow 'volume_create_manager' (5b7c731f-3d05-468e-81c5-73090518861f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:39.259634 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-36eaf8c5-a29e-4065-a619-dc987dbfddb3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Created volume successfully. Nov 06 21:25:40.308359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8c8b0d8d-8b82-44ee-bc2f-61f26b141c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:40.475984 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8c8b0d8d-8b82-44ee-bc2f-61f26b141c64 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Create snapshot completed successfully Nov 06 21:25:41.650910 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-035dbb9e-9054-4645-b5b3-fc2e00f8cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Lock "b'cinder-2e7a4541-3010-4fb8-8fb6-ef437c13177e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:25:41.652265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-035dbb9e-9054-4645-b5b3-fc2e00f8cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:42.501966 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-035dbb9e-9054-4645-b5b3-fc2e00f8cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Created reservations ['17780dc2-a0de-4d27-88d8-9716d792519a', '7fa57bf6-70ae-4d0f-9ced-f5ea2950856b', 'f2875994-946c-45cf-9ba1-0377a77430e7', '1ca1430e-fc25-46eb-804d-4b02d3d1350e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:42.534408 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-035dbb9e-9054-4645-b5b3-fc2e00f8cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Delete snapshot completed successfully. Nov 06 21:25:42.539528 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-035dbb9e-9054-4645-b5b3-fc2e00f8cc94 tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Lock "b'cinder-2e7a4541-3010-4fb8-8fb6-ef437c13177e-delete_snapshot'" released by "delete_snapshot" :: held 0.889s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:25:42.741351 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Lock "b'cinder-c1ef7a31-6372-4877-be54-90de33f4964b-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:25:42.772960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:42.808795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:42.809152 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Volume volume-c1ef7a31-6372-4877-be54-90de33f4964b is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:42.813766 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] deleting rbd volume volume-c1ef7a31-6372-4877-be54-90de33f4964b {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:43.005590 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Created reservations ['e837d0a4-9a6a-4732-b47a-8495dba2703e', '989c49e8-344a-4520-855f-0879854e6e97', 'fad46c48-568f-4b77-8bcb-e088c359740e', '9e0d494f-6abc-4f37-8c6e-94cb317c153f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:43.049671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:43.070504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:43.093079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:43.098902 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Deleted volume successfully. Nov 06 21:25:43.110544 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-44116456-d77a-4743-b8ee-29270483271c tempest-VolumeSnapshotQuotasNegativeTestJSON-1635190094 None] Lock "b'cinder-c1ef7a31-6372-4877-be54-90de33f4964b-delete_volume'" released by "delete_volume" :: held 0.369s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:25:46.903190 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:46.906429 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:46.908647 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:46.920510 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Flow 'volume_create_manager' (a6af54ac-3eac-4805-9844-db9b6e189353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:46.923504 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0297327-340e-4416-9af3-7463f88f26e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:46.929577 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:46.942458 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0297327-340e-4416-9af3-7463f88f26e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesTest-volume-764392839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=cac6d270-f8e2-4bf6-876f-8f2172fe1700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03f31ac0a69449e9b0de3ee3d8c08ac8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:47Z,use_quota=True,user_id='a818675d9eb045e6831c26d029fc97e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9afe73b-6961-4685-bf27-2ec7b69eb759),volume_type_id=b9afe73b-6961-4685-bf27-2ec7b69eb759)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:46.944889 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7cfa7d-ed61-4904-acd2-b8a100a9e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:46.946927 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7cfa7d-ed61-4904-acd2-b8a100a9e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:46.949209 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf84544-81e3-4f35-8f4b-d6253603cc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:46.951378 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baf84544-81e3-4f35-8f4b-d6253603cc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cac6d270-f8e2-4bf6-876f-8f2172fe1700', 'volume_name': 'volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:46.954318 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bcef85-b485-41d7-bd0e-1eddc4dcdf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:46.956408 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bcef85-b485-41d7-bd0e-1eddc4dcdf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:46.958481 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a03661b-4286-46b4-b6ab-9535fded57fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:46.959229 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Volume cac6d270-f8e2-4bf6-876f-8f2172fe1700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700', 'volume_size': 1} Nov 06 21:25:46.959612 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] creating volume 'volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:46.960597 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:47.009994 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:47.010448 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] extra_specs: {'storage_protocol': 'ceph', 'vendor_name': 'Open Source'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:47.012781 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a03661b-4286-46b4-b6ab-9535fded57fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:47.014962 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5366c3-9af4-4f5f-abfc-7404b3cf8361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:47.024076 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Volume volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700 (cac6d270-f8e2-4bf6-876f-8f2172fe1700): created successfully Nov 06 21:25:47.025893 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a5366c3-9af4-4f5f-abfc-7404b3cf8361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:47.028731 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Flow 'volume_create_manager' (a6af54ac-3eac-4805-9844-db9b6e189353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:47.036012 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bbff499e-724a-4fc3-be9e-422636155233 tempest-VolumeTypesTest-1241899184 None] Created volume successfully. Nov 06 21:25:48.153516 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b332c19d-12f9-4298-a8e0-8bbd9f3c9297 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:48.176055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b332c19d-12f9-4298-a8e0-8bbd9f3c9297 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:48.197257 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-b332c19d-12f9-4298-a8e0-8bbd9f3c9297 tempest-VolumeTypesTest-1241899184 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:48.202077 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b332c19d-12f9-4298-a8e0-8bbd9f3c9297 tempest-VolumeTypesTest-1241899184 None] Retype volume completed successfully. Nov 06 21:25:49.930356 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Lock "b'cinder-cac6d270-f8e2-4bf6-876f-8f2172fe1700-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:25:49.969674 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:50.005163 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:50.005588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Volume volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:50.010796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] deleting rbd volume volume-cac6d270-f8e2-4bf6-876f-8f2172fe1700 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:50.188312 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesTest-volume-type-112355897 is set by the default quota flag: quota_volumes_tempest-VolumeTypesTest-volume-type-112355897, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:50.188988 ncdv-master-1 cinder-volume[127482]: WARNING cinder.quota [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesTest-volume-type-112355897 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesTest-volume-type-112355897, it is now deprecated. Please use the default quota class for default quota. Nov 06 21:25:50.202212 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Created reservations ['72220b50-5459-4119-8261-208b60d6003d', '9fc288c7-ad5b-476a-8f0c-1afe5ae91f9e', 'cc7c745c-7454-46ab-a58e-1522208d5dfb', '32f75d0f-6020-4436-8f9d-7a73092805c6'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:50.241484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:50.262405 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:50.284871 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:50.289048 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Deleted volume successfully. Nov 06 21:25:50.301813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-149c6eca-581c-4d7c-8459-d100b1814880 tempest-VolumeTypesTest-1241899184 None] Lock "b'cinder-cac6d270-f8e2-4bf6-876f-8f2172fe1700-delete_volume'" released by "delete_volume" :: held 0.371s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:25:53.821530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:53.824823 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:53.825259 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:53.836831 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Flow 'volume_create_manager' (1797c478-32ee-4208-9616-c0e1d7396e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:53.839802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766b3466-e898-4f9c-a83c-22af60e0609b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.846255 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:53.857951 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (766b3466-e898-4f9c-a83c-22af60e0609b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1335529823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=92529bdd-a3d0-4508-a225-5d26df008a01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f5c8ab0ef0840f7a8cdfb30c55b56ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:54Z,use_quota=True,user_id='2bd8d675e0e04b94ac064fc83c642d3a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.861052 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2f90e1-c7ad-47b7-82d4-fa3276f386a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.863071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff2f90e1-c7ad-47b7-82d4-fa3276f386a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.865361 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161005ac-d634-424c-bba7-216e4e86c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.867478 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161005ac-d634-424c-bba7-216e4e86c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92529bdd-a3d0-4508-a225-5d26df008a01', 'volume_name': 'volume-92529bdd-a3d0-4508-a225-5d26df008a01', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.869666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc15a6-5957-4dc0-a98c-457fb404c792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.871666 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68cc15a6-5957-4dc0-a98c-457fb404c792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.873755 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e74cbbd-c2a6-48a2-8c22-fe79ab911daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.874494 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Volume 92529bdd-a3d0-4508-a225-5d26df008a01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92529bdd-a3d0-4508-a225-5d26df008a01', 'volume_size': 1} Nov 06 21:25:53.874875 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] creating volume 'volume-92529bdd-a3d0-4508-a225-5d26df008a01' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:53.875856 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:53.924869 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:53.925246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:53.927206 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e74cbbd-c2a6-48a2-8c22-fe79ab911daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92529bdd-a3d0-4508-a225-5d26df008a01', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.929289 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59942717-887a-438c-a681-2c2d3aa61374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:53.937637 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Volume volume-92529bdd-a3d0-4508-a225-5d26df008a01 (92529bdd-a3d0-4508-a225-5d26df008a01): created successfully Nov 06 21:25:53.939460 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59942717-887a-438c-a681-2c2d3aa61374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:53.942260 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Flow 'volume_create_manager' (1797c478-32ee-4208-9616-c0e1d7396e07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:53.949428 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4a6c0a02-3228-4076-8d70-8f26ccba9436 tempest-AbsoluteLimitsTests-1637086283 None] Created volume successfully. Nov 06 21:25:54.931310 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Lock "b'cinder-92529bdd-a3d0-4508-a225-5d26df008a01-delete_volume'" acquired by "delete_volume" :: waited 0.013s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:25:54.963671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:55.000945 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:25:55.001371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Volume volume-92529bdd-a3d0-4508-a225-5d26df008a01 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:25:55.007862 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] deleting rbd volume volume-92529bdd-a3d0-4508-a225-5d26df008a01 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:25:55.202313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Created reservations ['3524b224-3c07-4af2-ae8c-284c42fc68d0', 'd51dd40f-1239-4c48-a6d4-6fa08dfe1dbc', '7a5445dd-d45b-4b63-bb4f-2c7242ebaf29', '945b6134-6080-4faf-803c-ec452e2069bc'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:25:55.241813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:55.263369 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:55.285007 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:25:55.289498 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Deleted volume successfully. Nov 06 21:25:55.301401 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bd11c13c-a351-4df1-89c8-24e28610674b tempest-AbsoluteLimitsTests-1637086283 None] Lock "b'cinder-92529bdd-a3d0-4508-a225-5d26df008a01-delete_volume'" released by "delete_volume" :: held 0.370s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:25:58.903495 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:25:58.906809 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:25:58.907250 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:25:58.919207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Flow 'volume_create_manager' (cbf9204a-3509-49b4-881e-10e3028f5bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:58.922264 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be44274-5919-4e44-864e-4a0d5aef479b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:58.928113 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:25:58.940600 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4be44274-5919-4e44-864e-4a0d5aef479b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:25:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1187358374',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=38509e94-893a-4bcd-b31e-ec4d1f159c72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='701e70fcea614c108e0c7149f5614f14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:25:59Z,use_quota=True,user_id='74051e71cc8d4930a33609c7573801fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:58.943022 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3456c66c-ba60-4908-9a34-be833bb38b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:58.945108 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3456c66c-ba60-4908-9a34-be833bb38b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:58.947430 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa558e0b-999c-46e8-aaf7-d0e754eebbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:58.949596 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa558e0b-999c-46e8-aaf7-d0e754eebbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38509e94-893a-4bcd-b31e-ec4d1f159c72', 'volume_name': 'volume-38509e94-893a-4bcd-b31e-ec4d1f159c72', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:58.951798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82fa2d-0de3-4486-881c-2bb4a130c90a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:58.954431 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c82fa2d-0de3-4486-881c-2bb4a130c90a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:58.956566 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab8e532-dc23-4857-8a24-64a1df5501df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:58.957315 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Volume 38509e94-893a-4bcd-b31e-ec4d1f159c72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38509e94-893a-4bcd-b31e-ec4d1f159c72', 'volume_size': 1} Nov 06 21:25:58.957706 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] creating volume 'volume-38509e94-893a-4bcd-b31e-ec4d1f159c72' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:25:58.958655 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:25:59.007171 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:25:59.007546 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:25:59.009524 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab8e532-dc23-4857-8a24-64a1df5501df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38509e94-893a-4bcd-b31e-ec4d1f159c72', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:59.011620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080d872-c2b9-4ca0-88d4-851779b8e2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:25:59.020753 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Volume volume-38509e94-893a-4bcd-b31e-ec4d1f159c72 (38509e94-893a-4bcd-b31e-ec4d1f159c72): created successfully Nov 06 21:25:59.022672 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b080d872-c2b9-4ca0-88d4-851779b8e2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:25:59.025632 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Flow 'volume_create_manager' (cbf9204a-3509-49b4-881e-10e3028f5bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:25:59.033103 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b2027f32-8330-4bac-818c-9a2d23f9e74a tempest-VolumesActionsTest-1861903148 None] Created volume successfully. Nov 06 21:26:10.113263 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:26:10.114018 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:10.137416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:10.159588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:26:15.938145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-37f3136c-ab3f-4d04-af96-d48bdba04574 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72'" acquired by "attach_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:26:15.975905 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-37f3136c-ab3f-4d04-af96-d48bdba04574 tempest-VolumesActionsTest-1861903148 None] Attaching volume 38509e94-893a-4bcd-b31e-ec4d1f159c72 to instance ee22fffa-08da-4446-864e-a05ed7f73f03 at mountpoint /dev/sdb on host None. Nov 06 21:26:15.998011 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-37f3136c-ab3f-4d04-af96-d48bdba04574 tempest-VolumesActionsTest-1861903148 None] Attach volume completed successfully. Nov 06 21:26:16.003584 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-37f3136c-ab3f-4d04-af96-d48bdba04574 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72'" released by "attach_volume" :: held 0.065s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:26:16.106199 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e59888f4-693a-4856-b51d-2fcc57861eb6 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:26:16.106666 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e59888f4-693a-4856-b51d-2fcc57861eb6 tempest-VolumesActionsTest-1861903148 None] Detaching volume 38509e94-893a-4bcd-b31e-ec4d1f159c72 from instance ee22fffa-08da-4446-864e-a05ed7f73f03. Nov 06 21:26:16.148312 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e59888f4-693a-4856-b51d-2fcc57861eb6 tempest-VolumesActionsTest-1861903148 None] Detach volume completed successfully. Nov 06 21:26:16.152783 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e59888f4-693a-4856-b51d-2fcc57861eb6 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-detach_volume'" released by "detach_volume" :: held 0.047s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:26:29.897168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e5e9fc83-47df-45ba-9561-038f43424776 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72'" acquired by "attach_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:26:29.932496 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e5e9fc83-47df-45ba-9561-038f43424776 tempest-VolumesActionsTest-1861903148 None] Attaching volume 38509e94-893a-4bcd-b31e-ec4d1f159c72 to instance 93cc5d23-80ba-4f9c-9266-00cf653178b8 at mountpoint /dev/sdb on host None. Nov 06 21:26:29.954713 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e5e9fc83-47df-45ba-9561-038f43424776 tempest-VolumesActionsTest-1861903148 None] Attach volume completed successfully. Nov 06 21:26:29.959557 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e5e9fc83-47df-45ba-9561-038f43424776 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72'" released by "attach_volume" :: held 0.062s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:26:30.111258 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-16e79af8-33ba-4335-9a77-eefe36cc4dfd tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-detach_volume'" acquired by "detach_volume" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:26:30.111725 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-16e79af8-33ba-4335-9a77-eefe36cc4dfd tempest-VolumesActionsTest-1861903148 None] Detaching volume 38509e94-893a-4bcd-b31e-ec4d1f159c72 from instance 93cc5d23-80ba-4f9c-9266-00cf653178b8. Nov 06 21:26:30.153306 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-16e79af8-33ba-4335-9a77-eefe36cc4dfd tempest-VolumesActionsTest-1861903148 None] Detach volume completed successfully. Nov 06 21:26:30.157771 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-16e79af8-33ba-4335-9a77-eefe36cc4dfd tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-detach_volume'" released by "detach_volume" :: held 0.047s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:26:33.362521 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-361113fc-c45a-4600-9738-de2783890f5a tempest-VolumesActionsTest-1861903148 None] Running cmd (subprocess): rbd export --pool volumes volume-38509e94-893a-4bcd-b31e-ec4d1f159c72 /opt/stack/data/cinder/conversion/volume-38509e94-893a-4bcd-b31e-ec4d1f159c72-877356a4-906c-4db9-9ec8-64822d0157b8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:26:33.795829 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-361113fc-c45a-4600-9738-de2783890f5a tempest-VolumesActionsTest-1861903148 None] CMD "rbd export --pool volumes volume-38509e94-893a-4bcd-b31e-ec4d1f159c72 /opt/stack/data/cinder/conversion/volume-38509e94-893a-4bcd-b31e-ec4d1f159c72-877356a4-906c-4db9-9ec8-64822d0157b8 --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.433s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:26:33.805293 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.image_utils [None req-361113fc-c45a-4600-9738-de2783890f5a tempest-VolumesActionsTest-1861903148 None] 877356a4-906c-4db9-9ec8-64822d0157b8 was raw, no need to convert to raw {{(pid=127482) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:815}} Nov 06 21:26:48.273311 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-361113fc-c45a-4600-9738-de2783890f5a tempest-VolumesActionsTest-1861903148 None] Uploaded volume to glance image-id: 877356a4-906c-4db9-9ec8-64822d0157b8. {{(pid=127482) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1747}} Nov 06 21:26:48.292526 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-361113fc-c45a-4600-9738-de2783890f5a tempest-VolumesActionsTest-1861903148 None] Copy volume to image completed successfully. Nov 06 21:26:49.277717 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:26:49.308799 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:49.348015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:26:49.348519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Volume volume-38509e94-893a-4bcd-b31e-ec4d1f159c72 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:26:49.358862 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] deleting rbd volume volume-38509e94-893a-4bcd-b31e-ec4d1f159c72 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:26:49.564713 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Created reservations ['41a0991c-a658-4bd0-9276-a11b7ef54bab', 'f55af9d3-4cd4-4184-8453-6ea04bbf9c82', '2862712a-1060-41ef-9830-35f9f3b054a0', '89c81007-53c5-4023-b115-7d8f8d5b727d'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:26:49.607300 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:49.630501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:49.652810 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:26:49.657062 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Deleted volume successfully. Nov 06 21:26:49.668796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bc3f3bc1-902b-4686-885b-ce23f4963067 tempest-VolumesActionsTest-1861903148 None] Lock "b'cinder-38509e94-893a-4bcd-b31e-ec4d1f159c72-delete_volume'" released by "delete_volume" :: held 0.391s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:26:52.977377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:26:52.980873 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:26:52.981354 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:26:52.994530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (17e59f61-c207-4856-8c8b-1d83552b8a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:26:52.997670 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d11f72-9872-4f93-be06-9018e329aa1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.003808 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:26:53.015861 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d11f72-9872-4f93-be06-9018e329aa1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:26:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-658415411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=0ec0a7db-df57-43d7-aeab-fb28d412a109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:26:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:26:53Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.018407 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d1b9eb-93ea-4b0d-a993-df00789cb011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.020508 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18d1b9eb-93ea-4b0d-a993-df00789cb011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.022811 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c65ef4a-1d08-4c44-b759-86e78d765b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.025040 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c65ef4a-1d08-4c44-b759-86e78d765b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec0a7db-df57-43d7-aeab-fb28d412a109', 'volume_name': 'volume-0ec0a7db-df57-43d7-aeab-fb28d412a109', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.027246 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9db9485-ff52-4631-b3b8-c56fbf383fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.029330 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9db9485-ff52-4631-b3b8-c56fbf383fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.031439 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe40a6a-783e-41ca-9f2e-4bb15e2da6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.032197 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Volume 0ec0a7db-df57-43d7-aeab-fb28d412a109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec0a7db-df57-43d7-aeab-fb28d412a109', 'volume_size': 1} Nov 06 21:26:53.033143 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] creating volume 'volume-0ec0a7db-df57-43d7-aeab-fb28d412a109' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:26:53.034102 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:53.082447 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:26:53.082813 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:26:53.084854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe40a6a-783e-41ca-9f2e-4bb15e2da6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec0a7db-df57-43d7-aeab-fb28d412a109', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.087021 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8c444d-59ff-4891-90cb-21073c8f1348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:26:53.096090 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-0ec0a7db-df57-43d7-aeab-fb28d412a109 (0ec0a7db-df57-43d7-aeab-fb28d412a109): created successfully Nov 06 21:26:53.097834 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8c444d-59ff-4891-90cb-21073c8f1348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:26:53.100635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (17e59f61-c207-4856-8c8b-1d83552b8a42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:26:53.107833 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-1bad17a6-2832-40db-8828-0ace74c11926 tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:26:54.158579 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5c65bed8-353c-47d6-95a7-7773cf0e3d97 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:55.049307 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5c65bed8-353c-47d6-95a7-7773cf0e3d97 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:26:55.482014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.driver [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Creating a new backup for volume volume-0ec0a7db-df57-43d7-aeab-fb28d412a109. {{(pid=127482) _get_backup_volume_temp_volume /opt/stack/cinder/cinder/volume/driver.py:1226}} Nov 06 21:26:55.512632 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] cloning volumes/volume-0ec0a7db-df57-43d7-aeab-fb28d412a109@snapshot-1a7dfa96-4907-4c17-a512-30733f3300b1 to volume-90d0a252-2217-48eb-8627-e9707383cf6c {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:26:55.513259 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:55.559787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:26:55.668938 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:26:55.669309 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:26:55.699544 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:26:56.447497 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.748s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:26:56.448253 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90d0a252-2217-48eb-8627-e9707383cf6c', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '90d0a252-2217-48eb-8627-e9707383cf6c', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:26:56.462515 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Initialize volume connection completed successfully. Nov 06 21:27:04.534294 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Terminate volume connection completed successfully. Nov 06 21:27:04.555953 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Remove volume export completed successfully. Nov 06 21:27:04.589839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-90d0a252-2217-48eb-8627-e9707383cf6c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:27:04.602145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:04.655209 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:27:04.661334 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-90d0a252-2217-48eb-8627-e9707383cf6c {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:27:04.852170 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:27:04.856842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-adc260ce-7174-49c7-b5ff-57a12f75f964 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-90d0a252-2217-48eb-8627-e9707383cf6c-delete_volume'" released by "delete_volume" :: held 0.267s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:27:10.114888 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:27:10.115669 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:10.139789 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:10.166754 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:27:18.910691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:27:18.914330 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:27:18.915072 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:27:18.927934 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (7246ef47-5d1f-4067-a5df-23958e1501d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:27:18.931064 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67935221-3251-4952-9045-a78303fff00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:18.936979 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:27:18.948940 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67935221-3251-4952-9045-a78303fff00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1795060596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=90ca2f79-836b-4c1a-a651-e0a3518fcfe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:27:19Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:18.951371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859b69f2-144f-4fa9-b2b2-e7a6c2fd05e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:18.953530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (859b69f2-144f-4fa9-b2b2-e7a6c2fd05e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:18.955774 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5169efad-d387-4c40-8e84-e625d1e81aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:19.031456 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5169efad-d387-4c40-8e84-e625d1e81aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'volume_name': 'volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:19.033762 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3562163-7d4e-42b2-8ecc-1582b2dd6970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:19.036459 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3562163-7d4e-42b2-8ecc-1582b2dd6970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:19.038610 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21707090-151c-4954-81ab-3ecdb7786db8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:19.039389 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Volume 90ca2f79-836b-4c1a-a651-e0a3518fcfe7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 21:27:19.040215 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Cloning 90ca2f79-836b-4c1a-a651-e0a3518fcfe7 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 21:27:19.048436 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.007s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:27:19.060623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 27, 19, 55308)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:27:19.061112 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:27:19.061505 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 21:27:19.068350 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.020s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:27:19.069298 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 21:27:19.074548 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 21, 27, 19, 72423)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 21:27:19.074960 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 21:27:19.075352 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 21:27:19.087015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:19.135270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] creating snapshot='volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 21:27:19.272267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7.clone_snap' to 'volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 21:27:19.407055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:27:19.411899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:27:19.412271 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:27:19.428958 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 21:27:19.429620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Marking volume 90ca2f79-836b-4c1a-a651-e0a3518fcfe7 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 21:27:19.436986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to 90ca2f79-836b-4c1a-a651-e0a3518fcfe7. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 21:27:19.437406 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Creating volume glance metadata for volume 90ca2f79-836b-4c1a-a651-e0a3518fcfe7 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 21:27:19.484164 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21707090-151c-4954-81ab-3ecdb7786db8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:19.486290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e2b921-ec39-4baa-9d35-b127d7065795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:27:19.493760 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7 (90ca2f79-836b-4c1a-a651-e0a3518fcfe7): created successfully Nov 06 21:27:19.495550 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5e2b921-ec39-4baa-9d35-b127d7065795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:27:19.498348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (7246ef47-5d1f-4067-a5df-23958e1501d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:27:19.505511 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-041055cc-ba6f-4dd2-bcb1-cf859ba69cbf tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:27:20.309293 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-d7a26c75-7a2e-4406-8500-edab9c0553c8 req-4aab41c9-e554-4080-99f2-f8220ad656c0 tempest-VolumesSnapshotTestJSON-340105368 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:27:20.957337 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-d7a26c75-7a2e-4406-8500-edab9c0553c8 req-4aab41c9-e554-4080-99f2-f8220ad656c0 tempest-VolumesSnapshotTestJSON-340105368 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.647s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:27:20.958072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-d7a26c75-7a2e-4406-8500-edab9c0553c8 req-4aab41c9-e554-4080-99f2-f8220ad656c0 tempest-VolumesSnapshotTestJSON-340105368 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:27:20.979550 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-d7a26c75-7a2e-4406-8500-edab9c0553c8 req-4aab41c9-e554-4080-99f2-f8220ad656c0 tempest-VolumesSnapshotTestJSON-340105368 None] Connection info returned from driver {'name': 'volumes/volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '90ca2f79-836b-4c1a-a651-e0a3518fcfe7', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '3ad30def-329b-4e06-b226-96e841f7d603'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:27:21.023054 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-d7a26c75-7a2e-4406-8500-edab9c0553c8 req-4aab41c9-e554-4080-99f2-f8220ad656c0 tempest-VolumesSnapshotTestJSON-340105368 None] attachment_update completed successfully. Nov 06 21:27:23.593464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-73573732-15dd-4bc5-ad05-a9c4f2817ad5 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:24.322673 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-73573732-15dd-4bc5-ad05-a9c4f2817ad5 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:27:24.769741 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-ff57770c-34c3-4c04-bcb7-1b982d2592a2 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:25.331734 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-ff57770c-34c3-4c04-bcb7-1b982d2592a2 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:27:25.943626 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c13df8e2-23be-449b-8c9e-1d3ca6eda60f tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:26.339182 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c13df8e2-23be-449b-8c9e-1d3ca6eda60f tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:27:27.006600 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0ed8c6ee-17fd-4292-baf4-e4f9782c283f tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-8149c414-d248-4f68-92d4-8963e6e5d403-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:27:27.008131 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0ed8c6ee-17fd-4292-baf4-e4f9782c283f tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:27:57.158496 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0ed8c6ee-17fd-4292-baf4-e4f9782c283f tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['cbc08bdd-8fc2-40a7-8bfd-0c1ff7cd9499', 'c1a55f31-0615-41f8-896a-882711953315', '3a22958d-a33c-462f-9d3d-5afc0f8fcc83', '1691978e-6d89-4073-9a11-ed4bd706cd3a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:27:57.200704 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0ed8c6ee-17fd-4292-baf4-e4f9782c283f tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:27:57.206707 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0ed8c6ee-17fd-4292-baf4-e4f9782c283f tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-8149c414-d248-4f68-92d4-8963e6e5d403-delete_snapshot'" released by "delete_snapshot" :: held 30.200s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:27:57.828247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4a982b38-79a7-4497-92db-1e45d08da913 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-635f550f-4b1d-4293-9552-34ee1fa75303-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:27:57.830275 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4a982b38-79a7-4497-92db-1e45d08da913 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:28:10.111321 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:28:10.112717 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:28:10.141226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:28:10.163499 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:28:27.972933 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4a982b38-79a7-4497-92db-1e45d08da913 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['c040a4c0-3a81-49d3-a983-bc399eb12a6c', 'a41e29ce-7c28-482a-a227-92e2e2008e98', '9f82236a-bbaf-42aa-81fd-f4ae116523ee', '41435582-a256-4c42-9311-945395b7a83f'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:28:28.008310 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4a982b38-79a7-4497-92db-1e45d08da913 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:28:28.013013 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4a982b38-79a7-4497-92db-1e45d08da913 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-635f550f-4b1d-4293-9552-34ee1fa75303-delete_snapshot'" released by "delete_snapshot" :: held 30.185s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:28:28.663013 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bac2205e-70d0-4e9c-9887-c8965ef022b5 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-b2e444d7-238e-413e-b321-ab031d9a255e-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:28:28.664923 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-bac2205e-70d0-4e9c-9887-c8965ef022b5 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:28:58.845316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-bac2205e-70d0-4e9c-9887-c8965ef022b5 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['b60b8e71-7c28-41ea-a117-753ab337be8b', 'e11b9a00-6ff4-45ba-b325-a450a32f14cf', 'd8692d70-7b82-4c6c-a697-35b96632fe7a', '8860dc03-45d5-4262-9f5c-0dccbbb9eb79'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:28:58.884842 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-bac2205e-70d0-4e9c-9887-c8965ef022b5 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:28:58.890201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-bac2205e-70d0-4e9c-9887-c8965ef022b5 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-b2e444d7-238e-413e-b321-ab031d9a255e-delete_snapshot'" released by "delete_snapshot" :: held 30.227s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:29:00.262821 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a11d3cf7-a22c-403d-979d-084a783b44b6 req-5a89afca-c4fa-4d8c-8992-7d3fc0bf0c16 tempest-VolumesSnapshotTestJSON-340105368 None] Terminate volume connection completed successfully. Nov 06 21:29:00.263457 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a11d3cf7-a22c-403d-979d-084a783b44b6 req-5a89afca-c4fa-4d8c-8992-7d3fc0bf0c16 tempest-VolumesSnapshotTestJSON-340105368 None] Deleting attachment 3ad30def-329b-4e06-b226-96e841f7d603. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:29:04.469485 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-5a64c9cf-55fd-4710-acc1-6d7c0dc161ce tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:05.143777 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-5a64c9cf-55fd-4710-acc1-6d7c0dc161ce tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:29:05.639128 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0d252f77-8286-4bc5-a683-052ae5be89c7 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-1942289c-95f6-41bf-934e-64bb4642eaa2-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:29:05.640603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0d252f77-8286-4bc5-a683-052ae5be89c7 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:06.169603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0d252f77-8286-4bc5-a683-052ae5be89c7 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['2cccd2d5-8f1b-4646-b530-0b97b2c67ae3', 'c2a8eada-17b9-4ca9-896f-528cf201ddbf', '5c932d15-b210-41ca-bdad-2224704c125e', 'fb905527-b9db-4b0a-8788-b165f097522b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:29:06.201245 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0d252f77-8286-4bc5-a683-052ae5be89c7 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:29:06.205748 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0d252f77-8286-4bc5-a683-052ae5be89c7 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-1942289c-95f6-41bf-934e-64bb4642eaa2-delete_snapshot'" released by "delete_snapshot" :: held 0.567s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:29:06.833965 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b6ba49f2-2d31-40ec-8c2b-a894f1c9bd6b tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:07.170282 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b6ba49f2-2d31-40ec-8c2b-a894f1c9bd6b tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:29:10.109096 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:29:10.109828 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:10.135041 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:10.164551 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:29:19.450646 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 req-6744a59f-a797-4c1c-a6f4-5d8c41a550e0 tempest-VolumesSnapshotTestJSON-340105368 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:29:20.091867 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 req-6744a59f-a797-4c1c-a6f4-5d8c41a550e0 tempest-VolumesSnapshotTestJSON-340105368 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.641s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:29:20.092733 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 req-6744a59f-a797-4c1c-a6f4-5d8c41a550e0 tempest-VolumesSnapshotTestJSON-340105368 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-0ec0a7db-df57-43d7-aeab-fb28d412a109', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': '0ec0a7db-df57-43d7-aeab-fb28d412a109', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:29:20.115288 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 req-6744a59f-a797-4c1c-a6f4-5d8c41a550e0 tempest-VolumesSnapshotTestJSON-340105368 None] Connection info returned from driver {'name': 'volumes/volume-0ec0a7db-df57-43d7-aeab-fb28d412a109', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': '0ec0a7db-df57-43d7-aeab-fb28d412a109', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '1909b249-ffa3-41cf-a265-9dbf35bda02b'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:29:20.159106 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-31ea3ed1-71ef-4937-92c1-57a368ace4a0 req-6744a59f-a797-4c1c-a6f4-5d8c41a550e0 tempest-VolumesSnapshotTestJSON-340105368 None] attachment_update completed successfully. Nov 06 21:29:21.626728 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-da1d8dd5-d9e3-4745-8f16-a17079de8310 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:22.404007 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-da1d8dd5-d9e3-4745-8f16-a17079de8310 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:29:22.823125 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-b6f5ebff-57d7-479a-b48f-4f3e9c7e6e58 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:23.417800 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-b6f5ebff-57d7-479a-b48f-4f3e9c7e6e58 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:29:23.872572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4b93c9da-9443-458c-ad76-29122a8bfc36 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-e20246e8-a5e1-4262-92d4-fbc44d0cdf40-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:29:23.874140 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-4b93c9da-9443-458c-ad76-29122a8bfc36 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:29:53.998228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-4b93c9da-9443-458c-ad76-29122a8bfc36 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['b920cd22-cbbb-49fe-bb0a-74bd3e71e31a', 'b648df87-a891-42d6-a056-57e53b63ca2c', '3ffd3c40-420e-4240-8a3c-a540c3e0c0ba', 'c597157d-4c23-449e-b4f9-e569945d7a47'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:29:54.032044 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-4b93c9da-9443-458c-ad76-29122a8bfc36 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:29:54.036647 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-4b93c9da-9443-458c-ad76-29122a8bfc36 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-e20246e8-a5e1-4262-92d4-fbc44d0cdf40-delete_snapshot'" released by "delete_snapshot" :: held 30.164s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:29:54.693493 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0a06182e-52d4-445e-bbd1-5330081543d0 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-c466e429-5422-4c7e-ac8b-518b088ead70-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:29:54.695302 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-0a06182e-52d4-445e-bbd1-5330081543d0 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:30:10.110400 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:30:10.111177 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:30:10.132701 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:30:10.155315 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:30:24.835346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-0a06182e-52d4-445e-bbd1-5330081543d0 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['5415fec0-ebfc-4c73-b9d8-3856b0957254', 'ce83ad6b-e225-4d64-97f1-dce6c6ffdcb4', '1deef3ba-63e1-41dd-a314-adbe32b4cfff', '9af8817d-a041-4d8e-b30e-73bb2561f3e9'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:30:24.872714 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-0a06182e-52d4-445e-bbd1-5330081543d0 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:30:24.877382 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-0a06182e-52d4-445e-bbd1-5330081543d0 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-c466e429-5422-4c7e-ac8b-518b088ead70-delete_snapshot'" released by "delete_snapshot" :: held 30.184s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:30:25.520135 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8ec9b053-ce71-42d9-a6f7-6fae4b54d35b tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-84af658d-0a7b-416c-b846-ab53fb5b0034-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:30:25.522026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8ec9b053-ce71-42d9-a6f7-6fae4b54d35b tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:30:55.653316 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8ec9b053-ce71-42d9-a6f7-6fae4b54d35b tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['263c73f2-ca17-4afc-bcf9-f88f314811e9', 'e65b5c0e-89fd-40c1-b5a8-9e6c368c3d1c', '4df2ace8-e073-40de-ac32-38a530b2a26a', '138eb4b0-9a35-477c-9028-195a347a40f9'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:30:55.688694 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8ec9b053-ce71-42d9-a6f7-6fae4b54d35b tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:30:55.693249 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8ec9b053-ce71-42d9-a6f7-6fae4b54d35b tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-84af658d-0a7b-416c-b846-ab53fb5b0034-delete_snapshot'" released by "delete_snapshot" :: held 30.173s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:30:57.104888 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-24dc60ea-9715-4165-a0b2-b32b6066e644 req-7307ccda-555a-408d-8948-d928ae7337ef tempest-VolumesSnapshotTestJSON-340105368 None] Terminate volume connection completed successfully. Nov 06 21:30:57.105521 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-24dc60ea-9715-4165-a0b2-b32b6066e644 req-7307ccda-555a-408d-8948-d928ae7337ef tempest-VolumesSnapshotTestJSON-340105368 None] Deleting attachment 1909b249-ffa3-41cf-a265-9dbf35bda02b. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:31:01.416919 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:31:01.420928 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:31:01.421395 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:31:01.433740 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (0dcb4ed5-9d99-48b5-ae42-9371c9c1cfc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:01.436842 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f74962f-2319-4a37-b16d-51e31620121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.443786 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:31:01.455744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f74962f-2319-4a37-b16d-51e31620121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:31:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1302695265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=d60ff90e-4a96-401c-9ff8-175656202f8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:31:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:31:01Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.458228 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f4803-4144-44ce-ae4c-bec7770b10af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.460346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac0f4803-4144-44ce-ae4c-bec7770b10af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.462607 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1414fc8c-076b-4a42-8fdb-1ecb087afa94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.464767 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1414fc8c-076b-4a42-8fdb-1ecb087afa94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd60ff90e-4a96-401c-9ff8-175656202f8c', 'volume_name': 'volume-d60ff90e-4a96-401c-9ff8-175656202f8c', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.466934 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ca2612-6113-4b6c-a7c9-478b1dfc89df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.468975 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42ca2612-6113-4b6c-a7c9-478b1dfc89df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.471043 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb15760-59de-4474-a566-522530097b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.471778 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Volume d60ff90e-4a96-401c-9ff8-175656202f8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d60ff90e-4a96-401c-9ff8-175656202f8c', 'volume_size': 1} Nov 06 21:31:01.472200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] creating volume 'volume-d60ff90e-4a96-401c-9ff8-175656202f8c' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:31:01.473172 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:01.521964 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:31:01.522333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:31:01.524229 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb15760-59de-4474-a566-522530097b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d60ff90e-4a96-401c-9ff8-175656202f8c', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.526320 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136a06df-2589-4daa-93d3-34431470ac21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:01.534714 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-d60ff90e-4a96-401c-9ff8-175656202f8c (d60ff90e-4a96-401c-9ff8-175656202f8c): created successfully Nov 06 21:31:01.536518 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136a06df-2589-4daa-93d3-34431470ac21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:01.539294 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (0dcb4ed5-9d99-48b5-ae42-9371c9c1cfc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:01.546620 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-56b142b6-2108-47e2-a340-e9f69d5bb9fb tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:31:02.589522 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-7987bf87-49dd-49c2-993e-34ddc17606a9 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:02.775413 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-7987bf87-49dd-49c2-993e-34ddc17606a9 tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:31:03.934732 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:31:03.937975 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:31:03.938421 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:31:03.959313 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (2f020459-6845-40eb-8471-3c834a349626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:03.963011 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076e1cb5-dea6-40e5-a742-8f5ed2c38c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:03.969072 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:31:03.983023 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (076e1cb5-dea6-40e5-a742-8f5ed2c38c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1944203883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=383722ee-c24f-483b-937d-efecfe220978,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:31:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=9790d42b-e19e-4829-87f2-7e8461a967b7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:31:04Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:03.985537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fff378-9daa-4923-a64c-5e6507e3c584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:03.987593 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3fff378-9daa-4923-a64c-5e6507e3c584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:03.989935 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976ee2fc-1166-4a92-8b80-84df0c7a3789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:03.992435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (976ee2fc-1166-4a92-8b80-84df0c7a3789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '383722ee-c24f-483b-937d-efecfe220978', 'volume_name': 'volume-383722ee-c24f-483b-937d-efecfe220978', 'volume_size': 2, 'snapshot_id': '9790d42b-e19e-4829-87f2-7e8461a967b7'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:03.994635 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ffb159-b35a-4b57-90dc-b286ba0f8b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:03.996698 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29ffb159-b35a-4b57-90dc-b286ba0f8b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:03.998798 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe1c953-321d-4469-83a1-f35f943549fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:03.999548 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Volume 383722ee-c24f-483b-937d-efecfe220978: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-383722ee-c24f-483b-937d-efecfe220978', 'volume_size': 2, 'snapshot_id': '9790d42b-e19e-4829-87f2-7e8461a967b7'} Nov 06 21:31:04.017701 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] cloning volumes/volume-d60ff90e-4a96-401c-9ff8-175656202f8c@snapshot-9790d42b-e19e-4829-87f2-7e8461a967b7 to volume-383722ee-c24f-483b-937d-efecfe220978 {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:31:04.018598 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:04.064836 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:04.163814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:31:04.164110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:31:04.167676 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:04.264360 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ffe1c953-321d-4469-83a1-f35f943549fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383722ee-c24f-483b-937d-efecfe220978', 'volume_size': 2, 'snapshot_id': '9790d42b-e19e-4829-87f2-7e8461a967b7'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:04.266353 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237f26b2-dfb7-4987-b789-6adc160d1a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:04.273754 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-383722ee-c24f-483b-937d-efecfe220978 (383722ee-c24f-483b-937d-efecfe220978): created successfully Nov 06 21:31:04.275512 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (237f26b2-dfb7-4987-b789-6adc160d1a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:04.278327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (2f020459-6845-40eb-8471-3c834a349626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:04.289420 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c301e263-5c91-4e88-81fc-ddef431f58e7 tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:31:05.038702 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-383722ee-c24f-483b-937d-efecfe220978-delete_volume'" acquired by "delete_volume" :: waited 0.011s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:05.069678 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:05.117527 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:05.123866 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-383722ee-c24f-483b-937d-efecfe220978 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:05.322821 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['3cc11cbe-bef6-4488-9b0e-790f11e73bfb', '54dd56b6-57ab-4cb1-8cf4-b83a6d3b813e', '271db894-9063-4dd4-b0f9-e28264a3cae3', 'cb209147-3788-408c-b599-2cd8832e421a'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:05.360792 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:05.383075 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:05.404841 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:05.408977 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:05.420978 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-c58251e2-2875-47ab-be12-8d17a0cad14d tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-383722ee-c24f-483b-937d-efecfe220978-delete_volume'" released by "delete_volume" :: held 0.382s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:06.375055 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:31:06.378327 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:31:06.378767 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:31:06.390092 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (232fc7b6-601a-4e05-a4a7-8cf01efb6a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:06.393397 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f92dda-8ff1-44df-9761-3de5669fed92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.399325 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:31:06.411138 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f92dda-8ff1-44df-9761-3de5669fed92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:31:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-264287654',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=17956964-30e9-4d2a-90ef-b2c0ca94edad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:31:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:31:06Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.414134 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9338a00-3451-4011-bfab-58ec9cf5e5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.416180 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9338a00-3451-4011-bfab-58ec9cf5e5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.418752 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180b34f-3ffa-406b-9006-5aa6658cddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.420920 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180b34f-3ffa-406b-9006-5aa6658cddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17956964-30e9-4d2a-90ef-b2c0ca94edad', 'volume_name': 'volume-17956964-30e9-4d2a-90ef-b2c0ca94edad', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.423110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820896e-2e98-4d9c-9119-51871c60f2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.425165 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c820896e-2e98-4d9c-9119-51871c60f2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.427265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb9a640-eae2-4624-add1-eb691955aa1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.428008 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Volume 17956964-30e9-4d2a-90ef-b2c0ca94edad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17956964-30e9-4d2a-90ef-b2c0ca94edad', 'volume_size': 1} Nov 06 21:31:06.429026 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] creating volume 'volume-17956964-30e9-4d2a-90ef-b2c0ca94edad' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:31:06.429980 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:06.480112 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:31:06.480501 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:31:06.482512 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcb9a640-eae2-4624-add1-eb691955aa1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17956964-30e9-4d2a-90ef-b2c0ca94edad', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.484636 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790e5cce-bf6d-4dd6-9e32-a1abffa10b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:06.493471 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-17956964-30e9-4d2a-90ef-b2c0ca94edad (17956964-30e9-4d2a-90ef-b2c0ca94edad): created successfully Nov 06 21:31:06.495231 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (790e5cce-bf6d-4dd6-9e32-a1abffa10b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:06.498172 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (232fc7b6-601a-4e05-a4a7-8cf01efb6a08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:06.504989 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-94ece14b-4f96-47f1-b668-7411523d0bee tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:31:07.550969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2aeffc54-763a-4393-aa43-db1c4ff96c1c tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:08.163972 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2aeffc54-763a-4393-aa43-db1c4ff96c1c tempest-VolumesSnapshotTestJSON-340105368 None] Create snapshot completed successfully Nov 06 21:31:08.886734 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:31:08.890474 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:31:08.890914 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:31:08.911887 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (25e8ecd4-f78c-4c21-aacb-36f1ac3423ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:08.915534 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20bcd15-4591-4f19-bfd6-453fa0c5a5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:08.924378 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:31:08.936148 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f20bcd15-4591-4f19-bfd6-453fa0c5a5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-287974537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=868152d6-c619-4dac-9ba5-ba078b473f5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2f1edabb529405dbb79f70a83da7904',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=00e54a87-05fb-4cf8-b4eb-169e3e8c74ef,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:31:09Z,use_quota=True,user_id='8b89904b266f4acbbd99e238cad011d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:08.938726 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ca065-720c-4bb8-8771-6ce355b0dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:08.940804 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db6ca065-720c-4bb8-8771-6ce355b0dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:08.943069 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b781c89c-f7a7-4be5-9873-6c319a1c6049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:08.945410 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b781c89c-f7a7-4be5-9873-6c319a1c6049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '868152d6-c619-4dac-9ba5-ba078b473f5a', 'volume_name': 'volume-868152d6-c619-4dac-9ba5-ba078b473f5a', 'volume_size': 1, 'snapshot_id': '00e54a87-05fb-4cf8-b4eb-169e3e8c74ef'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:08.947588 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ede187-fb37-4286-829e-dee742181141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:08.949618 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03ede187-fb37-4286-829e-dee742181141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:08.951745 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e355079-d281-4ff1-b3f1-9438f4a07e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:08.952516 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Volume 868152d6-c619-4dac-9ba5-ba078b473f5a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-868152d6-c619-4dac-9ba5-ba078b473f5a', 'volume_size': 1, 'snapshot_id': '00e54a87-05fb-4cf8-b4eb-169e3e8c74ef'} Nov 06 21:31:08.970509 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] cloning volumes/volume-17956964-30e9-4d2a-90ef-b2c0ca94edad@snapshot-00e54a87-05fb-4cf8-b4eb-169e3e8c74ef to volume-868152d6-c619-4dac-9ba5-ba078b473f5a {{(pid=127482) _clone /opt/stack/cinder/cinder/volume/drivers/rbd.py:1025}} Nov 06 21:31:08.971400 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:09.015283 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:09.111107 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:31:09.111484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:31:09.127227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e355079-d281-4ff1-b3f1-9438f4a07e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-868152d6-c619-4dac-9ba5-ba078b473f5a', 'volume_size': 1, 'snapshot_id': '00e54a87-05fb-4cf8-b4eb-169e3e8c74ef'}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:09.129308 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2163096-c997-4e8b-ac91-a7825aabe79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:31:09.137798 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-868152d6-c619-4dac-9ba5-ba078b473f5a (868152d6-c619-4dac-9ba5-ba078b473f5a): created successfully Nov 06 21:31:09.139572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2163096-c997-4e8b-ac91-a7825aabe79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:31:09.142446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Flow 'volume_create_manager' (25e8ecd4-f78c-4c21-aacb-36f1ac3423ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:31:09.155048 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-debd1648-7451-4162-9244-9ef1853a43e2 tempest-VolumesSnapshotTestJSON-340105368 None] Created volume successfully. Nov 06 21:31:09.996395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-868152d6-c619-4dac-9ba5-ba078b473f5a-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:10.026333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:10.074161 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:10.079930 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-868152d6-c619-4dac-9ba5-ba078b473f5a {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:10.109860 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:31:10.110625 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:10.137994 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:10.162500 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:10.292930 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['3872d554-e420-44f7-8f09-7c06aa6973cc', '78921927-15d1-4aa8-a6cc-cb6b8142e6c4', '96b03aa3-dfa8-4dfe-88d1-89d27e27e22d', 'ce0459b6-a89f-4da1-862a-91fa11268769'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:10.333637 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:10.354976 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:10.376983 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:10.380796 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:10.395034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-2d4b771d-957f-4abc-8e23-6367afcfeeab tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-868152d6-c619-4dac-9ba5-ba078b473f5a-delete_volume'" released by "delete_volume" :: held 0.399s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:11.131645 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8c688c56-3437-4e44-81ad-91de3d99baa5 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-00e54a87-05fb-4cf8-b4eb-169e3e8c74ef-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:11.133201 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-8c688c56-3437-4e44-81ad-91de3d99baa5 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:11.484847 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-8c688c56-3437-4e44-81ad-91de3d99baa5 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['c21dfd97-313a-4f40-8dad-fdb0f7744ffd', '4612b759-16c7-40c6-bfbd-a0572529be48', '873ce6b6-7c3d-4250-9bbd-8f0856ddb8cc', '0e49e41f-fdc2-415d-aac7-c80f20e7c3d8'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:11.516735 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-8c688c56-3437-4e44-81ad-91de3d99baa5 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:31:11.521435 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-8c688c56-3437-4e44-81ad-91de3d99baa5 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-00e54a87-05fb-4cf8-b4eb-169e3e8c74ef-delete_snapshot'" released by "delete_snapshot" :: held 0.390s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:12.222892 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-17956964-30e9-4d2a-90ef-b2c0ca94edad-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:12.252611 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:12.290395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:12.290850 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-17956964-30e9-4d2a-90ef-b2c0ca94edad is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:31:12.297709 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-17956964-30e9-4d2a-90ef-b2c0ca94edad {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:12.509461 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['d0e69f3f-bc9a-4221-9a29-d836453d7bec', '75d974a6-82b6-4985-afc0-6f673919134d', '4e4a4033-0b98-4c16-80f7-c8854fc5897a', 'df34be10-6291-4bbc-bd0e-8fdc4bc9e57b'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:12.548107 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:12.569094 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:12.591422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:12.595350 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:12.607254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-db250ab0-1526-4ff5-9dd9-f14cea9baa3b tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-17956964-30e9-4d2a-90ef-b2c0ca94edad-delete_volume'" released by "delete_volume" :: held 0.384s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:13.357145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d137fc14-a087-48a9-8f7b-0612439a90be tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-9790d42b-e19e-4829-87f2-7e8461a967b7-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:13.358644 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-d137fc14-a087-48a9-8f7b-0612439a90be tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:14.507802 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-d137fc14-a087-48a9-8f7b-0612439a90be tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['16f54645-0a03-4771-9731-3727c646a676', '9aa93676-46ab-40b6-a53f-5ec01e291735', 'db443420-9d4f-482d-9eb5-0595d0e6b773', 'a518fa3a-3c81-4c8f-b3d7-276ad5b938f6'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:14.540062 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-d137fc14-a087-48a9-8f7b-0612439a90be tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:31:14.545455 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-d137fc14-a087-48a9-8f7b-0612439a90be tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-9790d42b-e19e-4829-87f2-7e8461a967b7-delete_snapshot'" released by "delete_snapshot" :: held 1.188s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:15.473040 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-d60ff90e-4a96-401c-9ff8-175656202f8c-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:15.504110 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:15.540226 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:15.540930 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-d60ff90e-4a96-401c-9ff8-175656202f8c is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:31:15.550185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-d60ff90e-4a96-401c-9ff8-175656202f8c {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:15.748931 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['215afbc3-20fe-4144-afd2-54921adc7cc8', '3cc5f8a9-b99d-424b-8c8d-72bd83cdc779', 'a4619263-ec68-4343-9c06-b900e44b537e', 'bf26016b-b71d-4915-aebf-b4d6618d3010'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:15.789192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:15.811067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:15.833054 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:15.837034 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:15.847841 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e43cb505-accc-4cd5-84fe-53520e62e1bd tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-d60ff90e-4a96-401c-9ff8-175656202f8c-delete_volume'" released by "delete_volume" :: held 0.375s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:16.702337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-90ca2f79-836b-4c1a-a651-e0a3518fcfe7-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:16.732157 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:16.792282 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:16.800068 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:16.976262 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 21:31:17.007519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] deleting parent snapshot volume-90ca2f79-836b-4c1a-a651-e0a3518fcfe7.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 21:31:17.524797 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['36de8049-f917-4a1f-8556-f9f4c84d44e7', '73d6a57c-3285-4b28-9d0e-f274c8c90adf', '04547380-f46c-4ba2-bae9-2b11f8425f9e', '0e50d3bb-dbb6-43b9-a104-78c4a1480a6e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:17.564208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:17.586473 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:17.608859 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:17.617353 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:17.631143 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-383f5f60-dbe0-472e-ab41-2c582e30f382 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-90ca2f79-836b-4c1a-a651-e0a3518fcfe7-delete_volume'" released by "delete_volume" :: held 0.929s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:17.815300 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-abb2be85-36b6-4c86-a96c-85375583c211 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-1a7dfa96-4907-4c17-a512-30733f3300b1-delete_snapshot'" acquired by "delete_snapshot" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:17.816787 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-abb2be85-36b6-4c86-a96c-85375583c211 tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:18.479171 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-abb2be85-36b6-4c86-a96c-85375583c211 tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['5a6547ac-9e11-4846-8df2-28c6303a3008', 'a59f1ccd-7c45-45e1-ae0d-44937951cd85', 'f93be9fe-8173-4c75-b809-9250597e6bfa', '7dc99298-def8-432d-ba11-27154821d66e'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:18.513140 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-abb2be85-36b6-4c86-a96c-85375583c211 tempest-VolumesSnapshotTestJSON-340105368 None] Delete snapshot completed successfully. Nov 06 21:31:18.517855 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-abb2be85-36b6-4c86-a96c-85375583c211 tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-1a7dfa96-4907-4c17-a512-30733f3300b1-delete_snapshot'" released by "delete_snapshot" :: held 0.703s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:31:18.915290 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-0ec0a7db-df57-43d7-aeab-fb28d412a109-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:31:18.945073 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:18.981218 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:31:18.981694 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Volume volume-0ec0a7db-df57-43d7-aeab-fb28d412a109 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:31:18.987185 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] deleting rbd volume volume-0ec0a7db-df57-43d7-aeab-fb28d412a109 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:31:19.196537 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Created reservations ['63b86031-85c8-4bdc-8638-4e2f104a34aa', '39767eb3-74e8-44b7-b95a-afc21c73882e', '787d57d9-fb5d-4de7-a767-c3f37c5e1f8d', '40879124-0918-4476-afc0-223720b3e538'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:31:19.234416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:19.256561 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:31:19.286696 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:31:19.291933 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Deleted volume successfully. Nov 06 21:31:19.305287 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-87dba688-38e2-49bb-a1a5-35598ea52dfb tempest-VolumesSnapshotTestJSON-340105368 None] Lock "b'cinder-0ec0a7db-df57-43d7-aeab-fb28d412a109-delete_volume'" released by "delete_volume" :: held 0.390s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:32:10.107852 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:32:10.108603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:32:10.129324 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:32:10.152234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:33:10.106758 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:33:10.107474 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:33:10.130396 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:33:10.153523 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:34:10.109107 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:34:10.109839 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:34:10.137446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:34:10.167466 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:35:10.113187 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:35:10.113880 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:35:10.135183 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:35:10.156572 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:36:10.111744 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:36:10.112462 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:36:10.133823 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:36:10.154797 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:37:10.109600 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:37:10.110304 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:37:10.132623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:37:10.153422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:38:10.108594 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:38:10.111200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:38:10.132274 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:38:10.154556 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:39:10.109396 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:39:10.110042 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:39:10.135577 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:39:10.173932 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:40:10.109257 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:40:10.109967 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:40:10.142650 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:40:10.170888 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:41:10.106747 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:41:10.107433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:41:10.131623 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:41:10.153208 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:42:10.108243 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:42:10.108971 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:42:10.130845 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:42:10.153576 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:43:10.108511 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:43:10.109187 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:43:10.135359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:43:10.157164 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:44:10.111968 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:44:10.112708 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:44:10.133717 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:44:10.155795 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:45:10.110629 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:45:10.111796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:45:10.134050 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:45:10.155003 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:46:10.109456 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:46:10.110168 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:46:10.131478 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:46:10.154129 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:47:10.110388 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:47:10.111034 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:47:10.132585 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:47:10.157386 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:48:10.111850 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:48:10.112523 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:48:10.133017 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:48:10.155089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:49:10.109558 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:49:10.110267 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:49:10.132173 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:49:10.153225 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:50:10.108307 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:50:10.109006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:50:10.129538 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:50:10.151006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:50:41.693429 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:50:41.696700 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:50:41.697231 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:50:41.708463 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Flow 'volume_create_manager' (263a74ab-dbc8-4bba-90fa-09b0989ff366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:50:41.711665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b530ca4-9311-4907-bfb4-0027bf1b3e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.717963 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:50:41.731944 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b530ca4-9311-4907-bfb4-0027bf1b3e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:50:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestJSON-volume-816784903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=e2680b66-e736-449e-9716-5ea61519c9e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26004b59815e4c2eb2f07cb2f1066ed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:50:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:50:42Z,use_quota=True,user_id='30877052910c43f8b93059d5edc5d333',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.734390 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ad23b-481e-4895-adcd-b19451b8b8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.736418 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f7ad23b-481e-4895-adcd-b19451b8b8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.738671 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49583086-d32e-4210-a4ea-4740b0964e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.741446 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49583086-d32e-4210-a4ea-4740b0964e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'volume_name': 'volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.743597 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32837deb-dfcc-4c41-b624-0e1f6489e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.745622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32837deb-dfcc-4c41-b624-0e1f6489e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.747689 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aae5f8-7360-46d4-be2e-31d2bf9502ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.748466 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Volume e2680b66-e736-449e-9716-5ea61519c9e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'volume_size': 1} Nov 06 21:50:41.748848 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] creating volume 'volume-e2680b66-e736-449e-9716-5ea61519c9e0' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:50:41.749785 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:50:41.798616 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:50:41.798989 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:50:41.801330 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6aae5f8-7360-46d4-be2e-31d2bf9502ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.804123 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39288be4-5c08-4b55-a037-b3896ef3f757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:50:41.812500 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Volume volume-e2680b66-e736-449e-9716-5ea61519c9e0 (e2680b66-e736-449e-9716-5ea61519c9e0): created successfully Nov 06 21:50:41.814279 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39288be4-5c08-4b55-a037-b3896ef3f757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:50:41.817084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Flow 'volume_create_manager' (263a74ab-dbc8-4bba-90fa-09b0989ff366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:50:41.823976 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-58045985-8e69-49b1-a094-160da7573c32 tempest-ServerActionsTestJSON-2001272451 None] Created volume successfully. Nov 06 21:50:43.539537 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-8b6acc21-ba14-43c8-8897-7141b0780ee6 req-8aed16b1-bbb0-4d3c-9037-cd710a16e19e tempest-ServerActionsTestJSON-2001272451 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:50:44.163985 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-8b6acc21-ba14-43c8-8897-7141b0780ee6 req-8aed16b1-bbb0-4d3c-9037-cd710a16e19e tempest-ServerActionsTestJSON-2001272451 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.624s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:50:44.164729 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-8b6acc21-ba14-43c8-8897-7141b0780ee6 req-8aed16b1-bbb0-4d3c-9037-cd710a16e19e tempest-ServerActionsTestJSON-2001272451 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:50:44.186559 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-8b6acc21-ba14-43c8-8897-7141b0780ee6 req-8aed16b1-bbb0-4d3c-9037-cd710a16e19e tempest-ServerActionsTestJSON-2001272451 None] Connection info returned from driver {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'ed263444-1df1-4906-9d27-fce9d92f0477'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:50:44.230737 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-8b6acc21-ba14-43c8-8897-7141b0780ee6 req-8aed16b1-bbb0-4d3c-9037-cd710a16e19e tempest-ServerActionsTestJSON-2001272451 None] attachment_update completed successfully. Nov 06 21:51:06.277265 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a330256c-4ea8-45ca-9828-72a9263e592f req-3dfbc49b-fc3d-4bae-a39c-9bc3b23ffefd tempest-ServerActionsTestJSON-2001272451 None] Terminate volume connection completed successfully. Nov 06 21:51:06.277983 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a330256c-4ea8-45ca-9828-72a9263e592f req-3dfbc49b-fc3d-4bae-a39c-9bc3b23ffefd tempest-ServerActionsTestJSON-2001272451 None] Deleting attachment ed263444-1df1-4906-9d27-fce9d92f0477. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:51:08.183995 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a330256c-4ea8-45ca-9828-72a9263e592f req-52599bca-50d7-42e9-ae8e-23744a7ed2cd tempest-ServerActionsTestJSON-2001272451 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:51:08.827215 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a330256c-4ea8-45ca-9828-72a9263e592f req-52599bca-50d7-42e9-ae8e-23744a7ed2cd tempest-ServerActionsTestJSON-2001272451 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.643s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:51:08.828015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a330256c-4ea8-45ca-9828-72a9263e592f req-52599bca-50d7-42e9-ae8e-23744a7ed2cd tempest-ServerActionsTestJSON-2001272451 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:51:08.851388 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a330256c-4ea8-45ca-9828-72a9263e592f req-52599bca-50d7-42e9-ae8e-23744a7ed2cd tempest-ServerActionsTestJSON-2001272451 None] Connection info returned from driver {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '5395f150-cf77-4253-8911-d052385c5a7a'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:51:08.898856 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a330256c-4ea8-45ca-9828-72a9263e592f req-52599bca-50d7-42e9-ae8e-23744a7ed2cd tempest-ServerActionsTestJSON-2001272451 None] attachment_update completed successfully. Nov 06 21:51:10.106901 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:51:10.107981 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:51:10.131191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:51:10.153254 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:51:17.468037 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1d8a8aac-dd7a-49fa-9787-f40423e3b11d tempest-ServerActionsTestJSON-2001272451 None] Terminate volume connection completed successfully. Nov 06 21:51:17.468691 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1d8a8aac-dd7a-49fa-9787-f40423e3b11d tempest-ServerActionsTestJSON-2001272451 None] Deleting attachment 5395f150-cf77-4253-8911-d052385c5a7a. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:51:20.018658 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1df522e9-dfc0-42b7-a332-cb86e031c0a6 tempest-ServerActionsTestJSON-2001272451 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:51:20.690744 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1df522e9-dfc0-42b7-a332-cb86e031c0a6 tempest-ServerActionsTestJSON-2001272451 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.672s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:51:20.691665 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1df522e9-dfc0-42b7-a332-cb86e031c0a6 tempest-ServerActionsTestJSON-2001272451 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:51:20.721433 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1df522e9-dfc0-42b7-a332-cb86e031c0a6 tempest-ServerActionsTestJSON-2001272451 None] Connection info returned from driver {'name': 'volumes/volume-e2680b66-e736-449e-9716-5ea61519c9e0', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'e2680b66-e736-449e-9716-5ea61519c9e0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '801f259a-9a42-40a3-b60f-032b42cac613'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:51:20.772853 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-55c157e3-beed-4111-b9ee-9ea6b81056a7 req-1df522e9-dfc0-42b7-a332-cb86e031c0a6 tempest-ServerActionsTestJSON-2001272451 None] attachment_update completed successfully. Nov 06 21:51:29.110180 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-58d313df-4d65-4e48-95c3-8c13ef53abec req-bcb0d339-489c-4181-bcd5-bef5d52f142d tempest-ServerActionsTestJSON-2001272451 None] Terminate volume connection completed successfully. Nov 06 21:51:29.110899 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-58d313df-4d65-4e48-95c3-8c13ef53abec req-bcb0d339-489c-4181-bcd5-bef5d52f142d tempest-ServerActionsTestJSON-2001272451 None] Deleting attachment 801f259a-9a42-40a3-b60f-032b42cac613. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:51:30.158006 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Lock "b'cinder-e2680b66-e736-449e-9716-5ea61519c9e0-delete_volume'" acquired by "delete_volume" :: waited 0.012s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:51:30.188245 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:51:30.225265 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:51:30.225736 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Volume volume-e2680b66-e736-449e-9716-5ea61519c9e0 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:51:30.230906 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] deleting rbd volume volume-e2680b66-e736-449e-9716-5ea61519c9e0 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:51:30.420058 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Created reservations ['d5fdd824-5200-47d6-aee4-9942e98ed481', 'd3b6b530-f803-40fd-9f40-9bff198a8746', '2181407f-a308-449e-8627-d4bf05985a65', '0c4e1703-a26c-4e0b-abfd-f2a58e5f9077'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:51:30.461200 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:51:30.487234 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:51:30.509957 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:51:30.514172 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Deleted volume successfully. Nov 06 21:51:30.525986 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-e13cd699-9889-497b-ba66-3b7d88626dd5 tempest-ServerActionsTestJSON-2001272451 None] Lock "b'cinder-e2680b66-e736-449e-9716-5ea61519c9e0-delete_volume'" released by "delete_volume" :: held 0.368s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:52:10.108834 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:52:10.109736 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:52:10.149723 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:52:10.184801 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:53:06.503908 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 21:53:06.508097 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 21:53:06.508590 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 21:53:06.521054 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Flow 'volume_create_manager' (2ab8686a-1367-4681-95fb-ea4e0c366fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:53:06.524244 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55871e5d-96eb-45d0-9e30-ef033ab7d95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.530385 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 21:53:06.542977 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55871e5d-96eb-45d0-9e30-ef033ab7d95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T21:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-177910802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=ea140385-59ea-472a-805e-1bffd2ee94f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='872e719b2a874cdc91e0c215ef3ea959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T21:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T21:53:06Z,use_quota=True,user_id='408897a95ae34cb1b49d3ec06752e4fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.545416 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fba478f-6279-4386-ac06-69da515831e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.547421 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fba478f-6279-4386-ac06-69da515831e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.549977 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e761c3-e8a6-443b-ad48-24ac3e432bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.552120 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e761c3-e8a6-443b-ad48-24ac3e432bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea140385-59ea-472a-805e-1bffd2ee94f1', 'volume_name': 'volume-ea140385-59ea-472a-805e-1bffd2ee94f1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.554348 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97c5a3-28c4-4495-bddf-192e5610c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.556363 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d97c5a3-28c4-4495-bddf-192e5610c47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.558420 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a290f92e-02da-47b6-a51c-b3426ac02605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.559152 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Volume ea140385-59ea-472a-805e-1bffd2ee94f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea140385-59ea-472a-805e-1bffd2ee94f1', 'volume_size': 1} Nov 06 21:53:06.559535 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] creating volume 'volume-ea140385-59ea-472a-805e-1bffd2ee94f1' {{(pid=127482) create_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:975}} Nov 06 21:53:06.560519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:53:06.607987 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 21:53:06.608383 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 21:53:06.610293 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a290f92e-02da-47b6-a51c-b3426ac02605) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea140385-59ea-472a-805e-1bffd2ee94f1', 'volume_size': 1}' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.612379 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253d3dd6-7b1d-4997-a203-70d1295323db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 21:53:06.621112 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Volume volume-ea140385-59ea-472a-805e-1bffd2ee94f1 (ea140385-59ea-472a-805e-1bffd2ee94f1): created successfully Nov 06 21:53:06.622997 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (253d3dd6-7b1d-4997-a203-70d1295323db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 21:53:06.625898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Flow 'volume_create_manager' (2ab8686a-1367-4681-95fb-ea4e0c366fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 21:53:06.633542 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-50254925-88b4-4376-9175-a71daa9e50dc tempest-TestMinimumBasicScenario-854053992 None] Created volume successfully. Nov 06 21:53:08.059505 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe req-1d266974-6f78-4ef2-8c4c-d5958e86bcb5 tempest-TestMinimumBasicScenario-854053992 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 21:53:08.728230 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe req-1d266974-6f78-4ef2-8c4c-d5958e86bcb5 tempest-TestMinimumBasicScenario-854053992 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.668s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 21:53:08.729079 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe req-1d266974-6f78-4ef2-8c4c-d5958e86bcb5 tempest-TestMinimumBasicScenario-854053992 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-ea140385-59ea-472a-805e-1bffd2ee94f1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'ea140385-59ea-472a-805e-1bffd2ee94f1', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 21:53:08.751515 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe req-1d266974-6f78-4ef2-8c4c-d5958e86bcb5 tempest-TestMinimumBasicScenario-854053992 None] Connection info returned from driver {'name': 'volumes/volume-ea140385-59ea-472a-805e-1bffd2ee94f1', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'ea140385-59ea-472a-805e-1bffd2ee94f1', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '7c4a4681-9564-45bc-8f94-810c08ce4418'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 21:53:08.794383 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-49f2c4dc-c15c-43bd-a79a-70917e75dbfe req-1d266974-6f78-4ef2-8c4c-d5958e86bcb5 tempest-TestMinimumBasicScenario-854053992 None] attachment_update completed successfully. Nov 06 21:53:10.111325 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:53:10.112395 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:53:10.139476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:53:10.163280 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:54:10.109384 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:54:10.110087 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:54:10.131192 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:54:10.152483 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:55:10.106765 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:55:10.107530 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:55:10.129337 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:55:10.150725 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:55:32.956891 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 req-75a2df67-e33e-41b4-939c-b54c27b1c963 tempest-TestMinimumBasicScenario-854053992 None] Terminate volume connection completed successfully. Nov 06 21:55:32.958114 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-0382d8bc-856c-48e1-9e3c-168fe1dfcd81 req-75a2df67-e33e-41b4-939c-b54c27b1c963 tempest-TestMinimumBasicScenario-854053992 None] Deleting attachment 7c4a4681-9564-45bc-8f94-810c08ce4418. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 21:55:33.555767 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Lock "b'cinder-ea140385-59ea-472a-805e-1bffd2ee94f1-delete_volume'" acquired by "delete_volume" :: waited 0.010s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 21:55:33.585686 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:55:33.631220 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 21:55:33.631760 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Volume volume-ea140385-59ea-472a-805e-1bffd2ee94f1 is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 21:55:33.636851 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] deleting rbd volume volume-ea140385-59ea-472a-805e-1bffd2ee94f1 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 21:55:33.825638 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Created reservations ['59bf479f-41d0-426d-98d6-657e512d02bf', '4254df0d-be2e-42b0-b1f2-2911450bbe56', 'c73e18d9-06b6-4fd9-9610-675e0847f25e', 'abfba2a3-7068-4c06-a330-de34c8ac1469'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 21:55:33.865757 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:55:33.888111 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:55:33.912190 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:55:33.917513 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Deleted volume successfully. Nov 06 21:55:33.929465 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-6f65360b-5730-485a-9a87-b544542c81d2 tempest-TestMinimumBasicScenario-854053992 None] Lock "b'cinder-ea140385-59ea-472a-805e-1bffd2ee94f1-delete_volume'" released by "delete_volume" :: held 0.374s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 21:56:10.107523 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:56:10.108219 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:56:10.129089 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:56:10.154209 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:57:10.110346 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:57:10.111067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:57:10.131829 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:57:10.153377 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:58:10.108185 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:58:10.108941 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:58:10.130371 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:58:10.151519 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 21:59:10.107302 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 21:59:10.108015 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:59:10.130843 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 21:59:10.151884 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:00:10.107318 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:00:10.108032 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:00:10.129346 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:00:10.151822 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:01:10.107878 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:01:10.108615 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:01:10.130207 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:01:10.150800 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:02:10.106788 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:02:10.107484 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:02:10.128750 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:02:10.150640 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:03:10.106614 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:03:10.107744 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:03:10.128834 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:03:10.150074 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:04:10.106268 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:04:10.106918 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:04:10.128170 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:04:10.149710 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:05:10.107476 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:05:10.108508 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:05:10.134540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:05:10.159837 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:06:10.110441 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:06:10.111620 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:06:10.134138 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:06:10.154947 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:07:10.112675 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:07:10.113535 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:07:10.139382 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:07:10.164818 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:08:10.111044 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:08:10.111768 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:08:10.132679 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:08:10.154067 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:09:10.110247 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:09:10.111359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:09:10.132322 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:09:10.159359 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:10:10.115451 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:10:10.116231 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:10:10.150969 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:10:10.174327 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:11:10.121115 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:11:10.121871 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:11:10.144599 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:11:10.165690 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:12:10.121407 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:12:10.122166 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:12:10.145794 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:12:10.172045 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:12:10.362886 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['ncdv-master-1@ceph#ceph'], 'hosts': ['ncdv-master-1@ceph#ceph']} {{(pid=127482) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1348}} Nov 06 22:12:10.366342 ncdv-master-1 cinder-volume[127482]: WARNING stevedore.named [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 22:12:10.366814 ncdv-master-1 cinder-volume[127482]: WARNING castellan.key_manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 22:12:10.379014 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Flow 'volume_create_manager' (f9517aea-c941-4c62-a32d-9e0d712b61ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 22:12:10.382118 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7dab8-3d94-4a7f-bee5-a72ac96c9101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:10.390112 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_db.sqlalchemy.engines [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127482) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 06 22:12:10.402196 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6e7dab8-3d94-4a7f-bee5-a72ac96c9101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2021-11-06T22:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1016076472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='ncdv-master-1@ceph#ceph',id=a46c546f-8575-440c-a9f5-a39df29d5eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7a47c6d4a6e4ada8f8d230f6f1a72f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2021-11-06T22:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2021-11-06T22:12:10Z,use_quota=True,user_id='baaf73954dfc4547a212c76c0be70fe8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(af9ed572-999f-44b7-9147-b36cc970d1a9),volume_type_id=af9ed572-999f-44b7-9147-b36cc970d1a9)' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:10.405112 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4857ef-6a5b-402f-8036-452cee37119c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:10.407175 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b4857ef-6a5b-402f-8036-452cee37119c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:10.409603 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679b0adf-f49e-4471-8adc-fff8f6e9bb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:10.486311 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (679b0adf-f49e-4471-8adc-fff8f6e9bb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a46c546f-8575-440c-a9f5-a39df29d5eb3', 'volume_name': 'volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:10.488598 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b88ea7-8f0c-4106-8b32-c02dfec46e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:10.490801 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b88ea7-8f0c-4106-8b32-c02dfec46e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:10.492928 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddfd9a3-535b-496a-b8f1-a0fc46837d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:10.493724 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Volume a46c546f-8575-440c-a9f5-a39df29d5eb3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 22:12:10.494277 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Cloning a46c546f-8575-440c-a9f5-a39df29d5eb3 from image 84b8d88b-fc57-44cc-ba26-535c5373e60c at location (None, None). {{(pid=127482) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1047}} Nov 06 22:12:10.502935 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" acquired by "_prepare_image_cache_entry" :: waited 0.008s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 22:12:10.511891 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 22, 12, 10, 506826)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 22:12:10.512333 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 22:12:10.512735 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Found cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _prepare_image_cache_entry /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:870}} Nov 06 22:12:10.516898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Lock "b'cinder-84b8d88b-fc57-44cc-ba26-535c5373e60c'" released by "_prepare_image_cache_entry" :: held 0.014s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 22:12:10.517782 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Attempting to retrieve cache entry for image = 84b8d88b-fc57-44cc-ba26-535c5373e60c on host ncdv-master-1@ceph#ceph. {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:811}} Nov 06 22:12:10.523405 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Found image-volume cache entry: {'id': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'volume_id': 'ae8659cd-f08f-4cc7-85c4-f26181745130', 'host': 'ncdv-master-1@ceph#ceph', 'size': 1, 'image_updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3), 'last_used': datetime.datetime(2021, 11, 6, 22, 12, 10, 521233)}. {{(pid=127482) get_entry /opt/stack/cinder/cinder/image/cache.py:76}} Nov 06 22:12:10.523925 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.image.cache [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Image-volume cache entry image_update_at = 2021-11-06 20:38:03+00:00, requested image updated_at = 2021-11-06 20:38:03+00:00. {{(pid=127482) _should_update_entry /opt/stack/cinder/cinder/image/cache.py:259}} Nov 06 22:12:10.524440 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Creating from source image-volume ae8659cd-f08f-4cc7-85c4-f26181745130 {{(pid=127482) _create_from_image_cache /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:825}} Nov 06 22:12:10.536109 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:12:10.584730 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] creating snapshot='volume-a46c546f-8575-440c-a9f5-a39df29d5eb3.clone_snap' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:722}} Nov 06 22:12:11.457392 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] cloning 'volume-ae8659cd-f08f-4cc7-85c4-f26181745130@volume-a46c546f-8575-440c-a9f5-a39df29d5eb3.clone_snap' to 'volume-a46c546f-8575-440c-a9f5-a39df29d5eb3' {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:728}} Nov 06 22:12:11.596854 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Volume volume-7f35eb51-5bb5-43ec-a170-cc81ed19014d.deleted is not a clone. {{(pid=127482) _get_clone_info /opt/stack/cinder/cinder/volume/drivers/rbd.py:1122}} Nov 06 22:12:11.601476 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_replicated_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:857}} Nov 06 22:12:11.601849 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] extra_specs: {'volume_backend_name': 'ceph'} {{(pid=127482) _is_multiattach_type /opt/stack/cinder/cinder/volume/drivers/rbd.py:866}} Nov 06 22:12:11.618998 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] clone created successfully {{(pid=127482) create_cloned_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:800}} Nov 06 22:12:11.619601 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.volume_utils [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Marking volume a46c546f-8575-440c-a9f5-a39df29d5eb3 as bootable. {{(pid=127482) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1178}} Nov 06 22:12:11.628144 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Copying metadata from image 84b8d88b-fc57-44cc-ba26-535c5373e60c to a46c546f-8575-440c-a9f5-a39df29d5eb3. {{(pid=127482) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:444}} Nov 06 22:12:11.628846 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Creating volume glance metadata for volume a46c546f-8575-440c-a9f5-a39df29d5eb3 backed by image 84b8d88b-fc57-44cc-ba26-535c5373e60c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': '', 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_name': 'ubuntu-16', 'checksum': '318f990048c8a194829e52141534610d', 'container_format': 'bare', 'disk_format': 'vhdx', 'min_disk': 0, 'min_ram': 0, 'size': 645922816}. {{(pid=127482) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:667}} Nov 06 22:12:11.682196 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddfd9a3-535b-496a-b8f1-a0fc46837d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'volume_size': 1, 'image_id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'image_location': (None, None), 'image_meta': {'name': 'ubuntu-16', 'disk_format': 'vhdx', 'container_format': 'bare', 'visibility': 'public', 'size': 645922816, 'virtual_size': 734003200, 'status': 'active', 'checksum': '318f990048c8a194829e52141534610d', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '3bb682cb4f4b47b1bea0e0b9f1872f3d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1aaa7a04b14d2fb410b8803fefeb767485c32e2da475b52a8839eec757ebef67d8611e4f699200324e39744ee6949dd3c2a4f6ecccb0c2480706ec5cb0fc5a53', 'id': '84b8d88b-fc57-44cc-ba26-535c5373e60c', 'created_at': datetime.datetime(2021, 11, 6, 20, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2021, 11, 6, 20, 38, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/84b8d88b-fc57-44cc-ba26-535c5373e60c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/ubuntu-16', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:11.684349 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e8580-d8e3-4369-8f0a-aa0d5d1a4537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:190}} Nov 06 22:12:11.692151 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.flows.manager.create_volume [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Volume volume-a46c546f-8575-440c-a9f5-a39df29d5eb3 (a46c546f-8575-440c-a9f5-a39df29d5eb3): created successfully Nov 06 22:12:11.694248 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472e8580-d8e3-4369-8f0a-aa0d5d1a4537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=127482) _task_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:178}} Nov 06 22:12:11.697301 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Flow 'volume_create_manager' (f9517aea-c941-4c62-a32d-9e0d712b61ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=127482) _flow_receiver /usr/local/lib/python3.8/dist-packages/taskflow/listeners/logging.py:141}} Nov 06 22:12:11.704236 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [None req-872dd4f2-dfb4-42dd-bfd5-0bf6eee1307a tempest-TestShelveInstance-1314861516 None] Created volume successfully. Nov 06 22:12:14.275409 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-db008a29-e72e-499a-8105-9806444241dc req-639e7d8b-adc0-4b1b-9482-def0ee276e76 tempest-TestShelveInstance-1314861516 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 22:12:14.933900 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-db008a29-e72e-499a-8105-9806444241dc req-639e7d8b-adc0-4b1b-9482-def0ee276e76 tempest-TestShelveInstance-1314861516 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.658s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 22:12:14.934618 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-db008a29-e72e-499a-8105-9806444241dc req-639e7d8b-adc0-4b1b-9482-def0ee276e76 tempest-TestShelveInstance-1314861516 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'a46c546f-8575-440c-a9f5-a39df29d5eb3', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 22:12:14.958959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-db008a29-e72e-499a-8105-9806444241dc req-639e7d8b-adc0-4b1b-9482-def0ee276e76 tempest-TestShelveInstance-1314861516 None] Connection info returned from driver {'name': 'volumes/volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a46c546f-8575-440c-a9f5-a39df29d5eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': 'b4e22f5e-48b1-4e25-bc75-fb7b5a193397'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 22:12:15.006051 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-db008a29-e72e-499a-8105-9806444241dc req-639e7d8b-adc0-4b1b-9482-def0ee276e76 tempest-TestShelveInstance-1314861516 None] attachment_update completed successfully. Nov 06 22:13:10.118251 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:13:10.119281 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:13:10.147984 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:13:10.176472 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:14:10.115734 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:14:10.116464 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:14:10.137183 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:14:10.159426 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:14:45.172514 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-2896f3b1-8763-45c2-bede-17f4f7241d56 req-0c1814f4-5d76-44fb-9fb1-728541f18f22 tempest-TestShelveInstance-1314861516 None] Terminate volume connection completed successfully. Nov 06 22:14:45.173376 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-2896f3b1-8763-45c2-bede-17f4f7241d56 req-0c1814f4-5d76-44fb-9fb1-728541f18f22 tempest-TestShelveInstance-1314861516 None] Deleting attachment b4e22f5e-48b1-4e25-bc75-fb7b5a193397. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 22:14:46.351019 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a1bb6e62-0c5d-45d4-b842-689274347a96 req-4a5a7bc6-516b-4f67-9107-fefd64e73c76 tempest-TestShelveInstance-1314861516 None] Running cmd (subprocess): ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Nov 06 22:14:46.977242 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_concurrency.processutils [req-a1bb6e62-0c5d-45d4-b842-689274347a96 req-4a5a7bc6-516b-4f67-9107-fefd64e73c76 tempest-TestShelveInstance-1314861516 None] CMD "ceph mon dump --format=json --id cinder --cluster ceph --conf /etc/ceph/ceph.conf" returned: 0 in 0.626s {{(pid=127482) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Nov 06 22:14:46.978071 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-a1bb6e62-0c5d-45d4-b842-689274347a96 req-4a5a7bc6-516b-4f67-9107-fefd64e73c76 tempest-TestShelveInstance-1314861516 None] connection data: {'driver_volume_type': 'rbd', 'data': {'name': 'volumes/volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': 'ceph', 'secret_uuid': 'd045347e-7923-456e-9e0d-82bea865ebee', 'volume_id': 'a46c546f-8575-440c-a9f5-a39df29d5eb3', 'discard': True}} {{(pid=127482) initialize_connection /opt/stack/cinder/cinder/volume/drivers/rbd.py:1524}} Nov 06 22:14:47.000357 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-a1bb6e62-0c5d-45d4-b842-689274347a96 req-4a5a7bc6-516b-4f67-9107-fefd64e73c76 tempest-TestShelveInstance-1314861516 None] Connection info returned from driver {'name': 'volumes/volume-a46c546f-8575-440c-a9f5-a39df29d5eb3', 'hosts': ['10.222.0.13'], 'ports': ['6789'], 'cluster_name': 'ceph', 'auth_enabled': True, 'auth_username': 'cinder', 'secret_type': '***', 'secret_uuid': '***', 'volume_id': 'a46c546f-8575-440c-a9f5-a39df29d5eb3', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'rbd', 'attachment_id': '04e92ceb-f198-4544-9da7-de41bb0b838a'} {{(pid=127482) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4808}} Nov 06 22:14:47.046678 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-a1bb6e62-0c5d-45d4-b842-689274347a96 req-4a5a7bc6-516b-4f67-9107-fefd64e73c76 tempest-TestShelveInstance-1314861516 None] attachment_update completed successfully. Nov 06 22:15:10.115215 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:15:10.116072 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:15:10.145084 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:15:10.174634 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:16:10.112243 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:16:10.112988 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:16:10.139879 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:16:10.160613 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:16:19.830641 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-20c8c43f-2bba-4a34-ae7e-2add8f641f31 tempest-TestShelveInstance-1314861516 None] Terminate volume connection completed successfully. Nov 06 22:16:19.831292 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.manager [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-20c8c43f-2bba-4a34-ae7e-2add8f641f31 tempest-TestShelveInstance-1314861516 None] Deleting attachment 04e92ceb-f198-4544-9da7-de41bb0b838a. {{(pid=127482) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:4944}} Nov 06 22:16:19.952106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] Lock "b'cinder-a46c546f-8575-440c-a9f5-a39df29d5eb3-delete_volume'" acquired by "delete_volume" :: waited 0.009s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:186}} Nov 06 22:16:19.982833 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:16:20.061329 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] volume has no backup snaps {{(pid=127482) _delete_backup_snaps /opt/stack/cinder/cinder/volume/drivers/rbd.py:1099}} Nov 06 22:16:20.074622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] deleting rbd volume volume-a46c546f-8575-440c-a9f5-a39df29d5eb3 {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1242}} Nov 06 22:16:20.342959 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] volume is a clone so cleaning references {{(pid=127482) delete_volume /opt/stack/cinder/cinder/volume/drivers/rbd.py:1263}} Nov 06 22:16:20.376898 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] deleting parent snapshot volume-a46c546f-8575-440c-a9f5-a39df29d5eb3.clone_snap {{(pid=127482) _delete_clone_parent_refs /opt/stack/cinder/cinder/volume/drivers/rbd.py:1155}} Nov 06 22:16:20.567992 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.quota [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] Created reservations ['9b5703d6-98a3-4538-b3d6-2c98a1fb9264', 'aec9fe53-4b19-4b33-bf97-5d130611627f', '3510fe3f-e348-4598-bcb4-e6eef394a8bb', '37c3310d-93dd-4021-94b3-5f9251d53059'] {{(pid=127482) reserve /opt/stack/cinder/cinder/quota.py:755}} Nov 06 22:16:20.609397 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:16:20.632540 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:16:20.655147 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:16:20.659237 ncdv-master-1 cinder-volume[127482]: INFO cinder.volume.manager [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] Deleted volume successfully. Nov 06 22:16:20.671308 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.coordination [req-818c6a7e-ef0c-4c21-9d16-e47c20dbe71c req-0f4c97d8-dd54-4d39-b63d-3502ad7a64c9 tempest-TestShelveInstance-1314861516 None] Lock "b'cinder-a46c546f-8575-440c-a9f5-a39df29d5eb3-delete_volume'" released by "delete_volume" :: held 0.719s {{(pid=127482) _synchronized /opt/stack/cinder/cinder/coordination.py:198}} Nov 06 22:17:10.115452 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:17:10.116186 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:17:10.136869 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:17:10.158425 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:18:10.114323 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:18:10.115053 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:18:10.136001 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:18:10.159422 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:19:10.115946 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:19:10.116699 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:19:10.137247 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:19:10.158796 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:20:10.114386 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:20:10.115145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:20:10.136681 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:20:10.158035 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:21:10.114296 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:21:10.115106 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:21:10.136650 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:21:10.157622 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:22:10.113013 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:22:10.113660 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:22:10.134808 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:22:10.156509 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:23:10.111465 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:23:10.112145 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:23:10.134047 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:23:10.156997 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:24:10.112474 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:24:10.113156 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:24:10.135199 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:24:10.156482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:25:10.112877 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:25:10.114057 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:25:10.136177 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:25:10.157988 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:26:10.114217 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:26:10.114881 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:26:10.135486 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:26:10.157299 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:27:10.113048 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:27:10.113695 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:27:10.134832 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:27:10.157227 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:28:10.114531 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:28:10.115191 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:28:10.136270 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:28:10.157814 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:29:10.114784 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:29:10.115436 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:29:10.136482 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:29:10.159859 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:30:10.115980 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:30:10.116673 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:30:10.137571 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:30:10.159503 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Nov 06 22:31:10.115470 ncdv-master-1 cinder-volume[127482]: DEBUG oslo_service.periodic_task [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=127482) run_periodic_tasks /usr/local/lib/python3.8/dist-packages/oslo_service/periodic_task.py:210}} Nov 06 22:31:10.116140 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:31:10.136707 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.volume.drivers.rbd [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] connecting to cinder@ceph (conf=/etc/ceph/ceph.conf, timeout=-1). {{(pid=127482) _do_conn /opt/stack/cinder/cinder/volume/drivers/rbd.py:480}} Nov 06 22:31:10.159662 ncdv-master-1 cinder-volume[127482]: DEBUG cinder.manager [None req-044261e4-c4a8-4d38-9316-34866df757e4 None None] Notifying Schedulers of capabilities ... {{(pid=127482) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}